00000001:02000400:0.0F:1789601224.948189:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789601244.633263:0:3523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789601246.674995:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 567 MB/s 00000001:01000000:2.0F:1789601246.926824:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 555 MB/s 00000001:01000000:2.0:1789601247.176869:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4555 MB/s 00000020:02000000:0.0:1789601248.046249:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga3f6967 00000400:02000000:1.0F:1789601248.965272:0:3629:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.148@tcp [8/256/0/180] 00008000:02000000:1.0:1789601253.397661:0:3779:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789601317.119863:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789601330.638820:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789601330.638831:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789601330.638833:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789601330.638983:0:6498:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000048aa10d4 00000080:02000400:1.0:1789601330.640337:0:6498:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789601330.656759:0:6498:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789601330.656774:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789601330.656807:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001f153be5) 00000020:00000080:1.0:1789601330.656833:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789601330.740367:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789601330.740465:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789601330.782424:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789601330.783110:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789601330.783121:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789601330.783136:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f1032 00000020:01000004:3.0:1789601330.783146:0:6498:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789601330.783379:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789601330.783387:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000048aa10d4 from MGS 00000020:01000004:3.0:1789601330.783393:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789601330.783417:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a4dada68) 00000020:00000080:3.0:1789601330.783431:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789601330.784884:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048aa10d4 from MGS, refs=2 00080000:01000000:1.0:1789601330.784901:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789601330.784912:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f1040 00000100:00100000:1.0:1789601330.785398:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789601330.785908:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789601330.785916:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789601330.786920:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789601330.786929:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789601330.788293:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601330.792783:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789601330.792802:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789601330.794033:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789601330.794044:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789601330.794420:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789601330.794427:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789601330.795491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601330.795496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601330.795498:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601330.795968:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601330.795971:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601330.795973:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601330.797246:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789601330.798700:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789601331.046692:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2611 MB/s 00000001:01000000:3.0:1789601331.297760:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3015 MB/s 00000001:01000000:2.0:1789601331.547856:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 579 MB/s 00000001:01000000:0.0:1789601331.802259:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 452 MB/s 00080000:10000000:0.0:1789601331.825876:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1789601331.845939:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789601331.867006:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789601331.875454:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789601331.875515:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789601331.875603:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789601331.875842:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789601331.875868:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789601331.876452:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601331.876657:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789601331.876666:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789601331.879290:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789601331.879301:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789601331.879662:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789601331.879670:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789601331.881420:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789601331.881443:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:3.0:1789601331.881445:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789601331.881882:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:3.0:1789601331.881894:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (000000006c5b216e) 00000020:00000080:3.0:1789601331.881909:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789601331.882020:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007705c97d@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601331.882167:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:3.0:1789601331.882174:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789601331.882968:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789601331.888964:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789601331.889023:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid 9ae79c1b-f0a7-456b-b85e-4e644036ec22) 00000020:00000080:2.0:1789601331.889045:0:6498:0:(genops.c:1384:class_connect()) connect: client 9ae79c1b-f0a7-456b-b85e-4e644036ec22, cookie 0x74872e3eca9f104e 00000100:00080000:2.0:1789601331.889058:0:6498:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601331.889069:0:6498:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import 000000007705c97d using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601331.889122:0:6498:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003b46189b x1876532918222976/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601331.889146:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS 00000020:01000004:2.0:1789601331.889165:0:6498:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789601331.889189:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789601331.889209:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a55875e8) 00000020:00000080:2.0:1789601331.889221:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789601331.893182:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b46189b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918222976:0@lo:250: 00000100:00100000:3.0:1789601331.893282:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601331.898171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918222976 00000100:00100000:0.0:1789601331.898191:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918222976 00000100:00100000:0.0:1789601331.898265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601331.898274:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c68db71c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3644:x1876532918222976:12345-0@lo:250: 00010000:00080000:0.0:1789601331.898309:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9ae79c1b-f0a7-456b-b85e-4e644036ec22@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789601331.898342:0:6515:0:(genops.c:1384:class_connect()) connect: client 9ae79c1b-f0a7-456b-b85e-4e644036ec22, cookie 0x74872e3eca9f105c 00000100:00080000:0.0:1789601331.898484:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000aab8318e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601331.898633:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c68db71c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:3644:x1876532918222976:12345-0@lo:250: Request processed in 359us (5351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601331.898641:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601331.899113:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789601331.899125:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:3.0:1789601331.899133:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789601331.899138:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789601331.899148:0:3644:0:(import.c:65:import_set_state_nolock()) 000000007705c97d MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789601331.899151:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789601331.899154:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789601331.899161:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b46189b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918222976:0@lo:250: 00000100:00100000:2.0:1789601331.919524:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601331.923864:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601331.923879:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789601331.926944:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789601331.926973:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789601331.929208:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789601331.929219:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789601331.930483:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601331.930944:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789601331.930950:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789601331.932541:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789601331.932873:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789601332.046480:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601332.046716:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789601332.046724:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789601332.055193:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789601332.055350:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789601332.060376:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601332.060601:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789601332.060608:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789601332.062286:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789601332.062296:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789601332.063342:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601332.063539:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789601332.063544:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789601332.064150:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789601332.064157:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789601332.066351:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601332.066516:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789601332.066528:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789601332.070756:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789601332.076047:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789601332.110482:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601332.110706:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601332.110713:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789601332.112518:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789601332.112532:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789601332.113901:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789601332.113912:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789601332.114812:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789601332.114844:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789601332.114852:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789601332.114975:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789601332.115011:0:6498:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789601332.115016:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789601332.115017:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601332.115019:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601332.115020:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601332.115021:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601332.115023:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601332.115024:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601332.115025:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601332.115027:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789601332.115028:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789601332.115029:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601332.115030:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601332.115032:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789601332.115034:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601332.115035:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601332.115036:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601332.115037:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601332.115038:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601332.115039:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601332.115040:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601332.115041:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601332.115042:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789601332.115043:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789601332.115044:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601332.115045:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601332.115085:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789601332.115105:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223104:0@lo:253: 00000100:00100000:1.0:1789601332.115185:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.115250:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011a25fef going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.115472:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223104 00000100:00100000:3.0:1789601332.115482:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223104 00000100:00100000:3.0:1789601332.115525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601332.115533:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000237c4637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6498:x1876532918223104:12345-0@lo:253: 20000000:01000000:3.0:1789601332.115608:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789601332.115612:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789601332.117771:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789601332.117925:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789601332.118249:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601332.121766:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789601332.122129:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789601332.122133:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789601332.122139:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789601332.122143:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789601332.122156:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789601332.122360:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601332.122538:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789601332.122551:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601332.122602:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789601332.122618:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789601332.122632:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789601332.122681:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789601332.122689:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789601332.122712:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789601332.122717:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789601332.122727:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789601332.122731:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789601332.122757:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789601332.122775:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789601332.122815:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789601332.122820:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789601332.122827:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601332.122917:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789601332.122926:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789601332.122939:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789601332.122966:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789601332.122981:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789601332.122991:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789601332.123014:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789601332.123022:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789601332.123033:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789601332.123046:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789601332.123060:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789601332.123068:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789601332.123091:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789601332.123099:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789601332.123110:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789601332.123122:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789601332.123177:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789601332.123198:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789601332.123204:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789601332.124195:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789601332.124388:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789601332.124411:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.148@tcp for mdt 20000000:01000000:3.0:1789601332.124413:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601332.124426:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789601332.124440:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789601332.124453:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789601332.124458:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601332.124483:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789601332.124492:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789601332.124503:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789601332.124517:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789601332.124543:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789601332.124546:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789601332.124549:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789601332.124629:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601332.124631:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789601332.128865:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789601332.129163:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789601332.129189:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789601332.129202:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789601332.129213:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789601332.129215:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789601332.129592:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789601332.129757:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789601332.129776:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789601332.129804:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789601332.129817:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601332.129819:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789601332.129827:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789601332.129829:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789601332.129834:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789601332.129840:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789601332.130676:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789601332.130869:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789601332.152144:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789601332.152181:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789601332.152195:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789601332.152220:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789601332.152244:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152275:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152285:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152291:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152297:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152302:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152307:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008423b5ec already unused, calling callback (00000000a9eeee50) 00010000:00010000:2.0:1789601332.152311:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152318:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152332:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152340:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.152345:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008423b5ec/0x74872e3eca9f1063 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601332.152373:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789601332.171766:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000237c4637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6498:x1876532918223104:12345-0@lo:253: Request processed in 56223us (56571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.171782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601332.171907:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223104:0@lo:253: 10000000:01000000:1.0:1789601332.171925:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789601332.171928:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601332.171930:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601332.171931:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601332.171933:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789601332.171934:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601332.171935:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601332.171937:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601332.171938:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601332.171940:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789601332.171941:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601332.171942:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789601332.171975:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000048aa10d4 from lustre-MDT0000 10000000:01000000:1.0:1789601332.172005:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789601332.172008:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601332.172012:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df4f3720000 10000000:01000000:1.0:1789601332.172016:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601332.172025:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f3720000 from 1 10000000:01000000:1.0:1789601332.172028:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789601332.172071:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.172083:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.172092:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601332.172110:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223232:0@lo:101: 00000100:00100000:1.0:1789601332.172146:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.172214:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:0.0:1789601332.172367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223232 00000100:00100000:0.0:1789601332.172375:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223232 00000100:00100000:0.0:1789601332.172423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601332.172431:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e93bc47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6498:x1876532918223232:12345-0@lo:101: 00010000:00010000:0.0:1789601332.172445:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601332.172458:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f106a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.172482:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f106a expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.172492:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f106a expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.172501:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5d3fca9, rc 0) 00000100:00100000:0.0:1789601332.172542:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e93bc47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6498:x1876532918223232:12345-0@lo:101: Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601332.172549:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601332.172688:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223232:0@lo:101: 00010000:00010000:1.0:1789601332.172714:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.172723:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601332.172773:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223360:0@lo:501: 00000100:00100000:1.0:1789601332.172797:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.172822:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.172875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223360 00000100:00100000:3.0:1789601332.172880:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223360 00000100:00100000:3.0:1789601332.172910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601332.172916:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af87a51f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6498:x1876532918223360:12345-0@lo:501: 00000100:00100000:3.0:1789601332.173003:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af87a51f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6498:x1876532918223360:12345-0@lo:501: Request processed in 88us (206us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601332.173009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601332.173079:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223360:0@lo:501: 10000000:01000000:1.0:1789601332.173103:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601332.173122:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173129:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601332.173135:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4d017d800 10000000:01000000:1.0:1789601332.173139:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789601332.173142:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df4d017d800 10000000:01000000:1.0:1789601332.173144:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789601332.173146:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df4d017d800 from 1 10000000:01000000:1.0:1789601332.173148:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789601332.173161:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173167:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173184:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601332.173195:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223488:0@lo:101: 00000100:00100000:1.0:1789601332.173218:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.173243:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.173296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223488 00000100:00100000:3.0:1789601332.173301:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223488 00000100:00100000:3.0:1789601332.173332:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601332.173337:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006cfea6c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6498:x1876532918223488:12345-0@lo:101: 00010000:00010000:3.0:1789601332.173343:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601332.173354:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000697fa364/0x74872e3eca9f107f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173375:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000697fa364/0x74872e3eca9f107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1078 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173382:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000697fa364/0x74872e3eca9f107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1078 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173388:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000697fa364, rc 0) 00000100:00100000:3.0:1789601332.173418:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006cfea6c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+7:6498:x1876532918223488:12345-0@lo:101: Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.173423:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601332.173585:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223488:0@lo:101: 00010000:00010000:1.0:1789601332.173595:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173602:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601332.173611:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789601332.173613:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173618:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 0000000029aa9b81/0x74872e3eca9f1078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601332.173623:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601332.173626:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601332.173629:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df4d017d800 10000000:01000000:1.0:1789601332.173631:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789601332.173634:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789601332.173635:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601332.173647:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173658:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173664:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601332.173674:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223616:0@lo:101: 00000100:00100000:1.0:1789601332.173697:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.173722:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.173773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223616 00000100:00100000:3.0:1789601332.173777:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223616 00000100:00100000:3.0:1789601332.173803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601332.173808:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d2eb03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+7:6498:x1876532918223616:12345-0@lo:101: 00010000:00010000:3.0:1789601332.173814:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601332.173820:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173832:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173839:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.173846:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000930f6bde, rc 0) 00000100:00100000:3.0:1789601332.173872:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d2eb03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+8:6498:x1876532918223616:12345-0@lo:101: Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.173878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601332.173968:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223616:0@lo:101: 00010000:00010000:1.0:1789601332.173977:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.173983:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601332.174024:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223744:0@lo:501: 00000100:00100000:1.0:1789601332.174049:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.174069:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.174218:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223744 00000100:00100000:3.0:1789601332.174222:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223744 00000100:00100000:3.0:1789601332.174249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601332.174254:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059fa0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+8:6498:x1876532918223744:12345-0@lo:501: 00000100:00100000:3.0:1789601332.174346:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059fa0769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6498:x1876532918223744:12345-0@lo:501: Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.174353:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601332.174476:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223744:0@lo:501: 00000100:00100000:1.0:1789601332.174503:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223872:0@lo:503: 00000100:00100000:1.0:1789601332.174541:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.174597:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82b7571 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.174673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918223872 00000100:00100000:3.0:1789601332.174679:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918223872 00000100:00100000:3.0:1789601332.174704:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601332.174710:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad7c35af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6498:x1876532918223872:12345-0@lo:503: 00000100:00100000:3.0:1789601332.174787:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad7c35af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6498:x1876532918223872:12345-0@lo:503: Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.174794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601332.174903:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918223872:0@lo:503: 00000100:00100000:1.0:1789601332.175312:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6543:1876532918224000:0@lo:502: 00000100:00100000:1.0:1789601332.175357:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.175380:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7a4a757 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.175432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224000 00000100:00100000:3.0:1789601332.175437:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224000 00000100:00100000:3.0:1789601332.175472:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601332.175479:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b152c448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6543:x1876532918224000:12345-0@lo:502: 00000100:00100000:3.0:1789601332.175585:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b152c448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6543:x1876532918224000:12345-0@lo:502: Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.175592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601332.175705:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6543:1876532918224000:0@lo:502: 00000020:01000000:1.0:1789601332.175729:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601332.175739:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.175741:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789601332.175746:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789601332.175749:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601332.175764:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d502fa12) 00000020:00000080:1.0:1789601332.175782:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789601332.175787:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789601332.175858:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789601332.175865:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f109b 00000020:00000080:1.0:1789601332.176095:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789601332.176099:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601332.176102:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.176104:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789601332.176106:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601332.176109:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.176111:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789601332.176114:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601332.176121:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006645822b) 00000020:00000080:1.0:1789601332.176130:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789601332.176133:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789601332.176135:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789601332.176137:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789601332.176143:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789601332.176192:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048aa10d4 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789601332.176207:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000045dcdbe6) 00000020:00000080:1.0:1789601332.176214:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789601332.176285:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789601332.176295:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f10b0 00000020:00000080:1.0:1789601332.176375:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789601332.176381:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789601332.176385:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x74872e3eca9f10b7 00080000:01000000:1.0:1789601332.176390:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789601332.176395:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f10be 00080000:10000000:1.0:1789601332.176960:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789601332.177096:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789601332.188920:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789601332.298548:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789601332.300236:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789601332.308008:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789601332.308341:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789601332.312064:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008acb3dc2) 00000020:00000080:2.0:1789601332.312091:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789601332.312173:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789601332.312183:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f10cc 00000020:00000080:3.0:1789601332.320182:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789601332.324404:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789601332.344292:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789601332.346439:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789601332.362260:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789601332.372301:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789601332.385381:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789601332.387373:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x74872e3eca9f10d3 00000020:00000080:1.0:1789601332.388643:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789601332.388657:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601332.388666:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.388668:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789601332.388671:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601332.388675:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.388676:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789601332.388678:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789601332.388680:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789601332.388682:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601332.388684:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.388685:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789601332.388687:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601332.388692:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.388692:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789601332.388696:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789601332.388738:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789601332.389047:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6543:1876532918224128:0@lo:502: 00000100:00100000:1.0:1789601332.389129:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.389184:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7a4a757 going to sleep for 11 seconds 00000100:00100000:2.0:1789601332.389668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224128 00000100:00100000:2.0:1789601332.389678:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224128 00000100:00100000:2.0:1789601332.389733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601332.389745:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cff9eccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6543:x1876532918224128:12345-0@lo:502: 00000100:00100000:2.0:1789601332.389898:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cff9eccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6543:x1876532918224128:12345-0@lo:502: Request processed in 156us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.389907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601332.390241:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6543:1876532918224128:0@lo:502: 00000020:01000000:1.0:1789601332.390275:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601332.390282:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601332.390283:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789601332.390287:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789601332.390430:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789601332.390451:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789601332.390470:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.390489:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601332.390497:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4d017d800 from 1 10000000:01000000:3.0:1789601332.390500:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601332.390537:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.390545:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.390553:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.390593:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224256:0@lo:101: 00000100:00100000:3.0:1789601332.390630:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.390662:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132cc359 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.390762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224256 00000100:00100000:1.0:1789601332.390767:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224256 00000100:00100000:1.0:1789601332.390814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601332.390820:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015d77e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:6498:x1876532918224256:12345-0@lo:101: 00010000:00010000:1.0:1789601332.390831:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601332.390842:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f10da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.390862:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f10da expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.390871:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10da expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.390880:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076ca57a3, rc 0) 00000100:00100000:1.0:1789601332.390913:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015d77e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:6498:x1876532918224256:12345-0@lo:101: Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.390920:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601332.391110:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224256:0@lo:101: 00010000:00010000:3.0:1789601332.391122:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.391130:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.392913:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224384:0@lo:256: 00000100:00100000:2.0:1789601332.393188:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601332.393231:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132cc359 going to sleep for 11 seconds 00000100:00100000:3.0:1789601332.393292:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224384 00000100:00100000:3.0:1789601332.393301:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224384 00000100:00100000:2.0:1789601332.398817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601332.398833:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e225a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:6498:x1876532918224384:12345-0@lo:256: 20000000:01000000:2.0:1789601332.398863:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789601332.398868:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789601332.399005:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e225a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:6498:x1876532918224384:12345-0@lo:256: Request processed in 175us (5818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.399013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789601332.399110:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224384:0@lo:256: 10000000:01000000:3.0:1789601332.399709:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601332.399737:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.399749:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601332.399757:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4d017d800 from 1 10000000:01000000:3.0:1789601332.399760:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601332.399794:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.399801:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.399810:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.399827:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224512:0@lo:101: 00000100:00100000:3.0:1789601332.399864:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.406656:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132cc359 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.413368:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224512 00000100:00100000:1.0:1789601332.413385:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224512 00000100:00100000:1.0:1789601332.413453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601332.413475:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab5ec866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:6498:x1876532918224512:12345-0@lo:101: 00010000:00010000:1.0:1789601332.413494:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601332.413528:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f10e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.413576:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.413587:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.413595:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000baa65020, rc 0) 00000100:00100000:1.0:1789601332.413673:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab5ec866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224512:12345-0@lo:101: Request processed in 212us (13809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.413679:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601332.414028:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224512:0@lo:101: 00010000:00010000:3.0:1789601332.414049:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.414058:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.414135:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224640:0@lo:501: 00000100:00100000:3.0:1789601332.414182:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.414219:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132cc359 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.414744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224640 00000100:00100000:1.0:1789601332.414752:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224640 00000100:00100000:1.0:1789601332.416121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601332.416144:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009abdc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224640:12345-0@lo:501: 00000100:00100000:1.0:1789601332.416648:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009abdc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224640:12345-0@lo:501: Request processed in 513us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.416659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601332.424365:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f924760c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224640:0@lo:501: 00000100:00100000:2.0:1789601332.434418:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d0c6c6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224768:0@lo:503: 00000100:00100000:2.0:1789601332.435119:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601332.435233:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058c3dc8e going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.442207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224768 00000100:00100000:1.0:1789601332.442226:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224768 00000100:00100000:0.0:1789601332.471083:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601332.471099:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f606626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224768:12345-0@lo:503: 00000040:00080000:0.0:1789601332.471165:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601332.471258:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f606626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224768:12345-0@lo:503: Request processed in 164us (36142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601332.471266:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601332.471363:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d0c6c6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224768:0@lo:503: 00000040:00080000:1.0:1789601332.477018:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789601332.480032:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789601332.480081:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601332.480153:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.480167:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601332.480225:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789601332.480228:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4d017d800 10000000:01000000:3.0:1789601332.480231:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4d017d800 10000000:01000000:3.0:1789601332.480235:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601332.480240:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4d017d800 from 1 10000000:01000000:3.0:1789601332.480243:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601332.480282:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.480290:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.480302:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.480327:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224896:0@lo:101: 00000100:00100000:3.0:1789601332.480393:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.480478:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053934549 going to sleep for 11 seconds 00000100:00100000:2.0:1789601332.483661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918224896 00000100:00100000:2.0:1789601332.483685:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918224896 00000100:00100000:2.0:1789601332.483769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601332.483793:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a8894af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6498:x1876532918224896:12345-0@lo:101: 00010000:00010000:2.0:1789601332.483813:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601332.483831:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f10f6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.483868:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.483881:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.483891:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008423b5ec, rc 0) 00000100:00100000:2.0:1789601332.483990:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a8894af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918224896:12345-0@lo:101: Request processed in 212us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.483997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601332.484482:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918224896:0@lo:101: 00010000:00010000:3.0:1789601332.484506:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.484515:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.484613:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225024:0@lo:501: 00000100:00100000:3.0:1789601332.484649:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.484682:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053934549 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.484754:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225024 00000100:00100000:1.0:1789601332.484761:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225024 00000100:00100000:1.0:1789601332.484799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601332.484806:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000934a6e3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225024:12345-0@lo:501: 00000100:00100000:1.0:1789601332.484919:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000934a6e3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225024:12345-0@lo:501: Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.484942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601332.485249:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225024:0@lo:501: 00000100:00100000:3.0:1789601332.485278:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225152:0@lo:503: 00000100:00100000:3.0:1789601332.485314:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.485339:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053934549 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.485387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225152 00000100:00100000:1.0:1789601332.485391:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225152 00000100:00100000:1.0:1789601332.485424:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601332.485430:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bec16a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225152:12345-0@lo:503: 00000100:00100000:1.0:1789601332.485628:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bec16a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225152:12345-0@lo:503: Request processed in 199us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.485635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601332.485735:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225152:0@lo:503: 00000100:00100000:3.0:1789601332.486452:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6548:1876532918225280:0@lo:502: 00000100:00100000:3.0:1789601332.486511:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.486545:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000445444bd going to sleep for 11 seconds 00000100:00100000:2.0:1789601332.486724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225280 00000100:00100000:2.0:1789601332.486731:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225280 00000100:00100000:2.0:1789601332.486772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601332.486779:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062460f6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6548:x1876532918225280:12345-0@lo:502: 00000100:00100000:2.0:1789601332.487040:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062460f6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6548:x1876532918225280:12345-0@lo:502: Request processed in 261us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.487047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601332.487173:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6548:1876532918225280:0@lo:502: 00000020:01000004:3.0:1789601332.487232:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789601332.487246:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000aeee48a3) 00000020:00000080:3.0:1789601332.487264:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789601332.487343:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048aa10d4 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789601332.487347:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000048aa10d4 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789601332.487349:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000048aa10d4 4 00010000:00080000:3.0:1789601332.487384:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000003094f72@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601332.495292:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789601332.495647:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789601332.495703:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601332.495719:0:6548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x74872e3eca9f110b 00000100:00080000:3.0:1789601332.495731:0:6548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601332.495743:0:6548:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003094f72 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601332.495799:0:6548:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003c2f7b2c x1876532918225408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601332.495823:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789601332.498706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918225408:0@lo:38: 00000100:00100000:2.0:1789601332.498795:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.500731:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007905f3b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6548:1876532918225536:0@lo:502: 00000100:00100000:3.0:1789601332.501023:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.501052:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bad0a65 going to sleep for 11 seconds 00000100:00100000:1.0:1789601332.501185:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225408 00000100:00100000:1.0:1789601332.501194:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225408 00000100:00100000:1.0:1789601332.501230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601332.501239:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a41acdf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918225408:12345-0@lo:38: 00000100:00100000:1.0:1789601332.501306:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a41acdf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918225408:12345-0@lo:38: Request processed in 67us (2510us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789601332.501312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601332.501667:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601332.501938:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000003094f72 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601332.501944:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789601332.502023:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c2f7b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918225408:0@lo:38: 00000100:00100000:1.0:1789601332.502055:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225536 00000100:00100000:1.0:1789601332.502060:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225536 00000100:00100000:1.0:1789601332.502100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601332.502107:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b14c1522 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6548:x1876532918225536:12345-0@lo:502: 00000100:00100000:1.0:1789601332.502237:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b14c1522 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6548:x1876532918225536:12345-0@lo:502: Request processed in 131us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601332.502244:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601332.503727:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007905f3b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6548:1876532918225536:0@lo:502: 00000040:00080000:3.0:1789601332.503771:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789601332.504258:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789601332.504282:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601332.504304:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.504323:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789601332.505098:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789601332.505101:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601332.505102:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601332.505103:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601332.505105:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601332.505106:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601332.505107:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601332.505109:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601332.505110:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789601332.505111:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789601332.505113:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601332.505114:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601332.505117:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789601332.505120:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601332.505121:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601332.505122:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601332.505123:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601332.505124:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601332.505126:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601332.505126:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601332.505127:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601332.505128:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789601332.505129:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789601332.505130:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601332.505131:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601332.505159:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789601332.505177:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225664:0@lo:253: 00000100:00100000:1.0:1789601332.505245:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601332.505344:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011a25fef going to sleep for 11 seconds 00000100:00100000:2.0:1789601332.514877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225664 00000100:00100000:2.0:1789601332.514910:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225664 00000100:00100000:2.0:1789601332.515064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601332.515076:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b523d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225664:12345-0@lo:253: 20000000:01000000:2.0:1789601332.515130:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789601332.515145:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789601332.538984:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789601332.539012:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789601332.539169:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789601332.539175:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789601332.539207:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.539239:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.539254:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.539310:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601332.539324:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601332.539349:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d90c0f5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918225792:0@lo:104: 00000100:00100000:0.0:1789601332.539418:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601332.539475:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018480bdb going to sleep for 11 seconds 00000100:00100000:2.0:1789601332.539544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225792 00000100:00100000:2.0:1789601332.539553:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225792 00000100:00100000:2.0:1789601332.539636:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601332.539644:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052372c84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918225792:12345-0@lo:104: 00010000:00010000:2.0:1789601332.539656:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601332.539713:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601332.539718:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052372c84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918225792:12345-0@lo:104: Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.539724:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601332.539805:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d90c0f5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918225792:0@lo:104: 00010000:00010000:0.0:1789601332.539825:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601332.540183:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b523d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6498:x1876532918225664:12345-0@lo:253: Request processed in 25110us (34938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601332.540192:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601332.540348:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed08c04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6498:1876532918225664:0@lo:253: 10000000:01000000:0.0:1789601332.540362:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789601332.540365:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601332.540367:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601332.540369:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601332.540370:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601332.540371:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601332.540372:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601332.540374:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601332.540376:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601332.540389:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601332.540391:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601332.540392:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601332.540394:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601332.540407:0:6498:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789601332.553355:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601332.553370:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.553382:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d54067d6 already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601332.553385:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.553395:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601332.553402:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601332.553408:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601332.553469:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.553475:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601332.553496:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.553502:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000d54067d6/0x74872e3eca9f10da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601332.553519:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601332.553521:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601332.553522:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601332.553668:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601332.553689:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007cfbf46f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918225920:0@lo:103: 00000100:00100000:3.0:1789601332.553770:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601332.553857:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918225920 00000100:00100000:3.0:1789601332.553866:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918225920 00010000:00010000:3.0:1789601332.553898:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.553931:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601332.553941:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007905f3b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3645:x1876532918225920:12345-0@lo:103: 00010000:00010000:3.0:1789601332.553971:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601332.553989:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554002:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554017:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076ca57a3/0x74872e3eca9f10e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f10da expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554036:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554045:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601332.554061:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014887876s 00010000:00010000:3.0:1789601332.554067:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554074:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554080:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554086:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554092:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000282c8d67 already unused, calling callback (00000000a9eeee50) 00010000:00010000:3.0:1789601332.554096:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554102:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554126:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554137:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601332.554175:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007905f3b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:3645:x1876532918225920:12345-0@lo:103: Request processed in 237us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601332.554182:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789601332.554209:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554217:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601332.554223:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000282c8d67/0x74872e3eca9f1112 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601332.554260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007cfbf46f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918225920:0@lo:103: 00080000:10000000:2.0:1789601332.558910:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.559159:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789601332.559392:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.559551:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789601332.567806:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.568501:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789601332.570812:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.571273:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789601332.571498:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.571897:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789601332.572944:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789601332.573307:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789601332.583451:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789601332.602865:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789601332.603880:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789601332.603889:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789601332.604795:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789601332.606756:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789601332.606937:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789601332.607408:0:6498:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789601332.607418:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789601332.607535:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601332.608631:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789601332.615177:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601332.617610:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789601332.617758:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789601332.621012:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789601332.621831:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789601332.623053:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789601332.623427:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789601332.623703:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789601332.625659:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789601332.629935:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:0.0:1789601332.631772:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789601332.631896:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789601332.631900:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789601332.632454:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789601332.632741:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789601332.633090:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789601332.634036:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789601332.634418:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789601332.635160:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789601332.635391:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789601332.635881:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789601332.636036:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789601332.636912:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789601332.637099:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789601332.637832:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789601332.638019:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789601332.638153:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789601332.638366:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789601332.639028:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789601332.639203:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789601332.639410:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789601332.639824:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789601332.639977:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789601332.640133:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789601332.640347:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789601332.640672:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789601332.641123:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789601332.641396:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789601332.642302:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789601332.642452:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789601332.643959:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789601332.653223:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789601332.653282:0:6498:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa27c81697988 00100000:10000000:3.0:1789601332.653292:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789601332.654260:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789601332.654282:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789601332.654304:0:6498:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789601332.654326:0:6498:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789601332.655355:0:6498:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601332.655652:0:6498:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789601332.880265:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601333.893840:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601334.921551:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601335.941798:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601336.966949:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601337.411172:0:6799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789601337.673537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789601337.673547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601337.673551:0:37:0:(import.c:65:import_set_state_nolock()) 0000000003094f72 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601337.673599:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003094f72 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601337.673702:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b9de8890 x1876532918226176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601337.673884:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a90017cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918226048:0@lo:400: 00000100:00100000:3.0:1789601337.673963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601337.674159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9de8890 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918226176:0@lo:38: 00000100:00100000:3.0:1789601337.674202:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601337.674385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226048 00000100:00100000:3.0:1789601337.674396:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226048 00000100:00100000:3.0:1789601337.674449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601337.674459:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cff1f428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:3647:x1876532918226048:12345-0@lo:400: 00000100:00100000:3.0:1789601337.674517:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cff1f428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:3647:x1876532918226048:12345-0@lo:400: Request processed in 59us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601337.674535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601337.674722:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a90017cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918226048:0@lo:400: 00000100:00100000:0.0:1789601337.677298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226176 00000100:00100000:0.0:1789601337.677318:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226176 00000100:00100000:0.0:1789601337.677365:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601337.677373:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000982197c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918226176:12345-0@lo:38: 00010000:00080000:0.0:1789601337.677405:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1789601337.677587:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x74872e3eca9f1119 00000004:00100000:0.0:1789601337.677634:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789601337.677834:0:6523:0:(import.c:65:import_set_state_nolock()) 000000005baea9d4 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601337.678017:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000982197c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876532918226176:12345-0@lo:38: Request processed in 644us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601337.678026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601337.678857:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b9de8890 x1876532918226176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789601337.678879:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789601337.678889:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789601337.678895:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789601337.678898:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000003094f72 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789601337.678906:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9de8890 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918226176:0@lo:38: 00010000:00010000:0.0:1789601337.989876:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601338.353322:0:6851:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601338.353696:0:6851:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789601339.016379:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601339.205676:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601339.205685:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4d017d800 from 3 10000000:01000000:3.0:1789601339.205689:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601339.205750:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601339.205775:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601339.205789:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601339.205815:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9de8890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918226304:0@lo:101: 00000100:00100000:3.0:1789601339.205890:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601339.206028:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e914dbf going to sleep for 11 seconds 00000100:00100000:2.0:1789601339.207986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226304 00000100:00100000:2.0:1789601339.208001:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226304 00000100:00100000:0.0:1789601339.211250:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601339.211267:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e680aaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:6519:x1876532918226304:12345-0@lo:101: 00010000:00010000:0.0:1789601339.211289:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601339.211312:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1120 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601339.211362:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601339.211374:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601339.211383:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000376977e9, rc 0) 00000100:00100000:0.0:1789601339.211482:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e680aaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918226304:12345-0@lo:101: Request processed in 219us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601339.211489:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601339.211607:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9de8890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918226304:0@lo:101: 00010000:00010000:1.0:1789601339.211627:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601339.211636:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601339.211707:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c213bfdc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918226432:0@lo:256: 00000100:00100000:1.0:1789601339.211753:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601339.218172:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9969c3c going to sleep for 11 seconds 00000100:00100000:3.0:1789601339.229164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226432 00000100:00100000:3.0:1789601339.229183:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226432 00000100:00100000:3.0:1789601339.229250:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601339.229274:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1ff39f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918226432:12345-0@lo:256: 20000000:01000000:3.0:1789601339.229306:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789601339.229322:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789601339.229325:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789601339.229931:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1ff39f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918226432:12345-0@lo:256: Request processed in 658us (18176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601339.229940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601339.230054:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c213bfdc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918226432:0@lo:256: 10000000:01000000:1.0:1789601339.230108:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601339.230118:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601339.230129:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601340.037924:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789601341.059028:0:6952:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601341.059370:0:6952:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601341.066929:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601342.087665:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601342.796861:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601342.796904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f1d2354 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918226688:0@lo:400: 00000100:00100000:0.0:1789601342.797001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601342.797246:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d90c0f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918226560:0@lo:400: 00000100:00100000:3.0:1789601342.797286:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601342.797336:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226688 00000100:00100000:3.0:1789601342.797344:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226688 00000100:00100000:3.0:1789601342.797394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601342.797402:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000181d36ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918226688:12345-0@lo:400: 00000100:00100000:0.0:1789601342.797601:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226560 00000100:00100000:0.0:1789601342.797606:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226560 00000100:00100000:0.0:1789601342.797640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601342.797646:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5aebb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3648:x1876532918226560:12345-0@lo:400: 00000100:00100000:0.0:1789601342.797697:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5aebb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3648:x1876532918226560:12345-0@lo:400: Request processed in 51us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601342.797705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601342.798184:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000181d36ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918226688:12345-0@lo:400: Request processed in 782us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601342.798192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601342.798243:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d90c0f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918226560:0@lo:400: 00010000:00080000:1.0:1789601342.798331:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f1d2354 x1876532918226688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601342.798344:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f1d2354 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918226688:0@lo:400: 00010000:00010000:2.0:1789601343.109869:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601344.140405:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601345.158815:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601346.181863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601347.206276:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601347.922745:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601347.922771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a90017cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918226816:0@lo:400: 00000100:00100000:3.0:1789601347.922859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601347.922917:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918226944:0@lo:400: 00000100:00100000:3.0:1789601347.922945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601347.922983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226816 00000100:00100000:3.0:1789601347.922992:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226816 00000100:00100000:3.0:1789601347.923042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601347.923051:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d23ec68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3645:x1876532918226816:12345-0@lo:400: 00000100:00100000:3.0:1789601347.923128:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d23ec68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3645:x1876532918226816:12345-0@lo:400: Request processed in 78us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601347.923136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601347.923176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918226944 00000100:00100000:3.0:1789601347.923179:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918226944 00000100:00100000:3.0:1789601347.923209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601347.923215:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092eda828 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918226944:12345-0@lo:400: 00000100:00100000:3.0:1789601347.923250:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092eda828 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918226944:12345-0@lo:400: Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601347.923256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601347.923302:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000003d86edf x1876532918226944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601347.923319:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918226944:0@lo:400: 00000100:00100000:3.0:1789601347.923342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a90017cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918226816:0@lo:400: 00010000:00010000:1.0:1789601348.230805:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601349.254034:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601350.278797:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601350.904887:0:7451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601350.904893:0:7451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789601350.904894:0:7451:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789601350.905078:0:7451:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000049a79f98 00000020:01000004:2.0:1789601350.905101:0:7451:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789601350.905116:0:7451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789601350.905134:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009ba8e62f) 00000020:00000080:2.0:1789601350.905153:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789601350.980469:0:7451:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789601350.980639:0:7451:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1789601351.009264:0:7451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789601351.009485:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789601351.009495:0:7451:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789601351.009511:0:7451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f1135 00000020:01000004:1.0:1789601351.009518:0:7451:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789601351.009539:0:7451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789601351.009543:0:7451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789601351.009549:0:7451:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789601351.010875:0:7451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789601351.010883:0:7451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789601351.034810:0:7451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789601351.034861:0:7451:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789601351.034866:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789601351.034867:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789601351.034869:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601351.034870:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601351.034871:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601351.034873:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601351.034874:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601351.034875:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601351.034877:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601351.034878:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601351.034880:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601351.034883:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789601351.034885:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601351.034886:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789601351.034887:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601351.034888:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601351.034889:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601351.034890:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601351.034891:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601351.034892:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601351.034893:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601351.034894:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601351.034895:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601351.034924:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789601351.034945:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb0f0d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918227072:0@lo:253: 00000100:00100000:0.0:1789601351.035168:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.035281:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533ccb23 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.035333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227072 00000100:00100000:3.0:1789601351.035341:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227072 00000100:00100000:3.0:1789601351.035431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601351.035440:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006383df8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:7451:x1876532918227072:12345-0@lo:253: 20000000:01000000:3.0:1789601351.035480:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789601351.035484:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789601351.035489:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789601351.035491:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789601351.035527:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789601351.035751:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601351.035884:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789601351.035903:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601351.035922:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789601351.035939:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789601351.035952:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789601351.036015:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789601351.036024:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789601351.036036:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789601351.036042:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789601351.036055:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789601351.036060:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789601351.036072:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789601351.036087:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789601351.036188:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789601351.036199:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601351.036227:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789601351.036236:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601351.036251:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789601351.036257:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601351.036270:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789601351.036275:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789601351.036288:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789601351.036306:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789601351.036317:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789601351.036408:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789601351.036418:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789601351.036434:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789601351.036452:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789601351.036471:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789601351.036477:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789601351.036492:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789601351.036524:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789601351.036531:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789601351.036550:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789601351.036593:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789601351.037023:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789601351.037211:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789601351.037230:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.148@tcp for mdt 20000000:01000000:1.0:1789601351.037232:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1789601351.037246:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789601351.037253:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789601351.037264:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789601351.037270:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1789601351.037283:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789601351.037290:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789601351.037302:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789601351.037316:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789601351.037360:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789601351.037368:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789601351.037828:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789601351.038169:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789601351.038188:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.148@tcp for mdt 20000000:01000000:1.0:1789601351.038190:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1789601351.038208:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789601351.038213:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789601351.038226:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789601351.038230:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1789601351.038241:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789601351.038248:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789601351.038260:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789601351.038275:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789601351.038294:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789601351.038296:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789601351.038312:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789601351.038358:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789601351.038361:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789601351.038749:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789601351.038769:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789601351.038783:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789601351.038934:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789601351.038953:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789601351.038971:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789601351.038979:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789601351.038981:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789601351.039213:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789601351.039244:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789601351.039259:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789601351.039536:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789601351.039891:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789601351.039914:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789601351.039924:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789601351.039926:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789601351.040144:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789601351.040159:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789601351.040168:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789601351.040350:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789601351.040364:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789601351.040376:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789601351.040387:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789601351.040389:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789601351.040393:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789601351.040399:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789601351.040678:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789601351.040783:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789601351.063154:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789601351.063342:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063361:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f106a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063368:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063393:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063400:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063445:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063458:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 12 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.063472:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bb32356 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227200:0@lo:104: 00000100:00100000:0.0:1789601351.063537:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601351.063661:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063670:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 12 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.063678:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b94b7be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227328:0@lo:104: 00000100:00100000:0.0:1789601351.063704:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601351.063731:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.063738:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 12 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.063746:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227456:0@lo:104: 00000100:00100000:0.0:1789601351.063775:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.063785:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2455171 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.063921:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227200 00000100:00100000:3.0:1789601351.063930:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227200 00000100:00100000:3.0:1789601351.063980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227328 00000100:00100000:3.0:1789601351.063984:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227328 00000100:00100000:3.0:1789601351.063995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227456 00000100:00100000:3.0:1789601351.063998:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227456 00000100:00100000:3.0:1789601351.064010:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601351.064018:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fbe1d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6514:x1876532918227200:12345-0@lo:104: 00010000:00010000:3.0:1789601351.064029:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.064103:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601351.064108:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fbe1d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6514:x1876532918227200:12345-0@lo:104: Request processed in 91us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.064116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789601351.064124:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601351.064131:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064141:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789601351.064141:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002af1d5ee already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601351.064146:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064159:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003cdbd1a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6514:x1876532918227328:12345-0@lo:104: 00000100:00100000:2.0:1789601351.064159:0:6504:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1789601351.064168:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.064169:0:6504:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789601351.064174:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601351.064185:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601351.064191:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601351.064210:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601351.064215:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003cdbd1a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6514:x1876532918227328:12345-0@lo:104: Request processed in 60us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.064221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789601351.064228:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064236:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789601351.064238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601351.064246:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7888804 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6514:x1876532918227456:12345-0@lo:104: 00010000:00010000:3.0:1789601351.064253:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064256:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064269:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f10f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064282:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601351.064285:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.064289:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789601351.064291:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e64cbe05 already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601351.064296:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064297:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7888804 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6514:x1876532918227456:12345-0@lo:104: Request processed in 52us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.064310:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789601351.064313:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601351.064321:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.064336:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789601351.064347:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789601351.064358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c213bfdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918227584:0@lo:103: 00010000:00010000:1.0:1789601351.064372:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064380:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789601351.064391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601351.064396:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064404:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f1086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f108d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.064417:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601351.064419:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601351.064421:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601351.064429:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601351.064440:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9a185ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918227712:0@lo:103: 00000100:00100000:3.0:1789601351.064482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227584 00000100:00100000:3.0:1789601351.064487:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227584 00000100:00100000:1.0:1789601351.064493:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601351.064506:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227712 00000100:00100000:3.0:1789601351.064534:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227712 00000100:00100000:1.0:1789601351.064540:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789601351.064546:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 14 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601351.064552:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a90017cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3648:x1876532918227584:12345-0@lo:103: 00010000:00010000:1.0:1789601351.064590:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601351.064599:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064607:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789601351.064613:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.064614:0:6506:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789601351.064629:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789601351.064634:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601351.064639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601351.064647:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059fa5519 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3646:x1876532918227712:12345-0@lo:103: 00010000:00010000:3.0:1789601351.064656:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601351.064661:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 14 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.064670:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 14 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.064681:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601351.064727:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059fa5519 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3646:x1876532918227712:12345-0@lo:103: Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.064733:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789601351.064851:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008423b5ec/0x74872e3eca9f10fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f10f6 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.064862:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bb32356 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227200:0@lo:104: 00010000:00010000:0.0:1789601351.064872:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000930f6bde/0x74872e3eca9f108d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1086 expref: 12 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.064880:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b94b7be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227328:0@lo:104: 00000100:00100000:0.0:1789601351.064886:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876532918227456:0@lo:104: 00010000:00010000:0.0:1789601351.064907:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601351.064941:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a90017cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:3648:x1876532918227584:12345-0@lo:103: Request processed in 123us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.064956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601351.065013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9a185ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918227712:0@lo:103: 00000100:00100000:3.0:1789601351.065595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c213bfdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918227584:0@lo:103: 00010000:00010000:3.0:1789601351.065805:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601351.065809:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601351.065810:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601351.065848:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.065858:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005b3818da already unused, calling callback (000000006971bf21) 10000000:00010000:0.0:1789601351.065861:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.065867:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601351.065874:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.065879:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601351.065915:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.065929:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601351.065951:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.065957:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 000000005b3818da/0x74872e3eca9f106a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1071 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.065974:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601351.065976:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601351.065977:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601351.065984:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601351.065994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918227840:0@lo:103: 00000100:00100000:0.0:1789601351.066037:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.066081:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227840 00000100:00100000:0.0:1789601351.066087:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227840 00010000:00010000:0.0:1789601351.066104:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.066129:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601351.066135:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b94b7be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:3645:x1876532918227840:12345-0@lo:103: 00010000:00010000:0.0:1789601351.066145:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601351.066149:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066157:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066167:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5d3fca9/0x74872e3eca9f1071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f106a expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066191:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066198:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066212:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066218:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066223:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066229:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066234:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bad19c8c already unused, calling callback (00000000a9eeee50) 00010000:00010000:0.0:1789601351.066238:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066243:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066255:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066264:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601351.066294:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b94b7be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:3645:x1876532918227840:12345-0@lo:103: Request processed in 160us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.066312:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601351.066348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918227840:0@lo:103: 00010000:00010000:0.0:1789601351.066364:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066371:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.066376:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bad19c8c/0x74872e3eca9f113c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789601351.066392:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789601351.072646:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006383df8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:7451:x1876532918227072:12345-0@lo:253: Request processed in 37199us (37470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.072661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601351.076478:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb0f0d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918227072:0@lo:253: 10000000:01000000:2.0:1789601351.076503:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789601351.076506:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789601351.076508:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789601351.076510:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601351.076511:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789601351.076512:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601351.076514:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601351.076515:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789601351.076516:0:7451:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789601351.076518:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601351.076519:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789601351.076546:0:7451:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000049a79f98 from lustre-MDT0001 10000000:01000000:2.0:1789601351.076610:0:7451:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789601351.076614:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789601351.076621:0:7451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f3720000 local copy 10000000:01000000:2.0:1789601351.076625:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789601351.076670:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.076682:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.076692:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.076711:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918227968:0@lo:101: 00000100:00100000:2.0:1789601351.076773:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.076842:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eb4be83 going to sleep for 11 seconds 00000100:00100000:0.0:1789601351.076915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918227968 00000100:00100000:0.0:1789601351.076925:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918227968 00000100:00100000:0.0:1789601351.076976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601351.076986:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072f5b573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+9:7451:x1876532918227968:12345-0@lo:101: 00010000:00010000:0.0:1789601351.077001:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601351.077014:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b7398db/0x74872e3eca9f114a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1143 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.077039:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b7398db/0x74872e3eca9f114a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1143 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.077050:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b7398db/0x74872e3eca9f114a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1143 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.077058:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b7398db, rc 0) 00000100:00100000:0.0:1789601351.077101:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072f5b573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:7451:x1876532918227968:12345-0@lo:101: Request processed in 116us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.077126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601351.077380:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918227968:0@lo:101: 00010000:00010000:2.0:1789601351.077395:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.077413:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.077517:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228096:0@lo:501: 00000100:00100000:2.0:1789601351.077545:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.077600:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eb4be83 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.077769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228096 00000100:00100000:1.0:1789601351.077775:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228096 00000100:00100000:1.0:1789601351.077822:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601351.077830:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3cf8f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:7451:x1876532918228096:12345-0@lo:501: 00000100:00100000:1.0:1789601351.077894:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3cf8f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:7451:x1876532918228096:12345-0@lo:501: Request processed in 65us (348us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601351.077902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601351.080392:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228096:0@lo:501: 10000000:01000000:2.0:1789601351.080423:0:7451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789601351.080466:0:7451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789601351.080474:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.080485:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.080493:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.080522:0:7451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789601351.080551:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4f8b56000 10000000:01000000:2.0:1789601351.080586:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789601351.080591:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df4f3720000 10000000:01000000:2.0:1789601351.080594:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789601351.080597:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df4f3720000 from 1 10000000:01000000:2.0:1789601351.080599:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789601351.080633:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.080659:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.080671:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.080689:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228224:0@lo:101: 00000100:00100000:2.0:1789601351.080742:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.080783:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.080877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228224 00000100:00100000:3.0:1789601351.080885:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228224 00000100:00100000:3.0:1789601351.080934:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601351.080942:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091b55d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+10:7451:x1876532918228224:12345-0@lo:101: 00010000:00010000:3.0:1789601351.080954:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601351.080967:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6f9b3ae/0x74872e3eca9f1158 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1151 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.081002:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6f9b3ae/0x74872e3eca9f1158 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1151 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.081012:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6f9b3ae/0x74872e3eca9f1158 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1151 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.081021:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6f9b3ae, rc 0) 00000100:00100000:3.0:1789601351.081058:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091b55d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:7451:x1876532918228224:12345-0@lo:101: Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.081065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601351.081144:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228224:0@lo:101: 00010000:00010000:2.0:1789601351.081157:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081165:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601351.081180:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789601351.081196:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081202:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000e86d56a6/0x74872e3eca9f1151 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601351.081209:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df4f8b56000 10000000:01000000:2.0:1789601351.081213:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789601351.081215:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df4f8b56000 from 1 10000000:01000000:2.0:1789601351.081217:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789601351.081230:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081243:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081250:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.081261:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228352:0@lo:101: 00000100:00100000:2.0:1789601351.081289:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.081306:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.081321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228352 00000100:00100000:2.0:1789601351.081326:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228352 00000100:00100000:2.0:1789601351.081346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601351.081353:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007fd440a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+11:7451:x1876532918228352:12345-0@lo:101: 00010000:00010000:2.0:1789601351.081359:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601351.081366:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069e4ebd0/0x74872e3eca9f1166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f115f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081379:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069e4ebd0/0x74872e3eca9f1166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f115f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081385:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069e4ebd0/0x74872e3eca9f1166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f115f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081391:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069e4ebd0, rc 0) 00000100:00100000:2.0:1789601351.081417:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007fd440a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:7451:x1876532918228352:12345-0@lo:101: Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.081422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601351.081449:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228352:0@lo:101: 00010000:00010000:2.0:1789601351.081464:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081470:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601351.081479:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789601351.081481:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081486:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000b0048e1c/0x74872e3eca9f115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601351.081491:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789601351.081494:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789601351.081497:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df4f8b56000 10000000:01000000:2.0:1789601351.081499:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789601351.081501:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789601351.081503:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789601351.081514:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081519:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081526:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.081536:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228480:0@lo:101: 00000100:00100000:2.0:1789601351.081582:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.081597:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.081613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228480 00000100:00100000:2.0:1789601351.081617:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228480 00000100:00100000:2.0:1789601351.081632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601351.081637:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd854b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:7451:x1876532918228480:12345-0@lo:101: 00010000:00010000:2.0:1789601351.081643:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601351.081650:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ff00898/0x74872e3eca9f1174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f116d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ff00898/0x74872e3eca9f1174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f116d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081667:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ff00898/0x74872e3eca9f1174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f116d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081672:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ff00898, rc 0) 00000100:00100000:2.0:1789601351.081698:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd854b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228480:12345-0@lo:101: Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.081703:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601351.081726:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228480:0@lo:101: 00010000:00010000:2.0:1789601351.081735:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.081741:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.081808:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228608:0@lo:501: 00000100:00100000:2.0:1789601351.081842:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.081850:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.081873:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228608 00000100:00100000:2.0:1789601351.081877:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228608 00000100:00100000:2.0:1789601351.081893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601351.081897:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e09c7074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228608:12345-0@lo:501: 00000100:00100000:2.0:1789601351.081995:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e09c7074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228608:12345-0@lo:501: Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.082003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601351.082026:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228608:0@lo:501: 00000100:00100000:2.0:1789601351.082050:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228736:0@lo:503: 00000100:00100000:2.0:1789601351.082089:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.082097:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.082113:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228736 00000100:00100000:2.0:1789601351.082116:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228736 00000100:00100000:2.0:1789601351.082132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601351.082137:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad827920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228736:12345-0@lo:503: 00000100:00100000:2.0:1789601351.082219:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad827920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228736:12345-0@lo:503: Request processed in 82us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.082226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601351.082258:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228736:0@lo:503: 00000040:00080000:2.0:1789601351.082508:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789601351.082609:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228864:0@lo:502: 00000100:00100000:2.0:1789601351.082643:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.082652:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.082672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228864 00000100:00100000:2.0:1789601351.082676:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228864 00000100:00100000:2.0:1789601351.082692:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601351.082697:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efb561b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228864:12345-0@lo:502: 00000100:00100000:2.0:1789601351.082780:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efb561b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228864:12345-0@lo:502: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.082787:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601351.082829:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228864:0@lo:502: 00000040:00080000:2.0:1789601351.083019:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789601351.083044:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789601351.083057:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789601351.083070:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789601351.083083:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789601351.083095:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789601351.083106:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789601351.083116:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789601351.083126:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789601351.083136:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789601351.083148:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789601351.083159:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789601351.083171:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789601351.083183:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789601351.083193:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789601351.083216:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789601351.083230:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789601351.083242:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789601351.083253:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789601351.083265:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789601351.083276:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789601351.083287:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789601351.083298:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789601351.083316:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228992:0@lo:502: 00000100:00100000:2.0:1789601351.083349:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.083361:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022e9b817 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.083389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918228992 00000100:00100000:2.0:1789601351.083394:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918228992 00000100:00100000:2.0:1789601351.083410:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601351.083415:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000096c4fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228992:12345-0@lo:502: 00000100:00100000:2.0:1789601351.083494:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000096c4fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918228992:12345-0@lo:502: Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.083501:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601351.083619:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c238345 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918228992:0@lo:502: 00000040:00080000:0.0:1789601351.083689:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789601351.083698:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:1.0:1789601351.083994:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601351.084001:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084010:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008cedc7d6 already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601351.084013:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084022:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601351.084029:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601351.084034:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601351.084058:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084074:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601351.084103:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084110:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 000000008cedc7d6/0x74872e3eca9f1143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f114a expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084123:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601351.084126:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601351.084127:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601351.084131:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522f5a64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918229120:0@lo:103: 00000100:00100000:0.0:1789601351.084173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.084296:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229120 00000100:00100000:1.0:1789601351.084301:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229120 00000100:00100000:1.0:1789601351.084335:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601351.084342:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001483c09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3647:x1876532918229120:12345-0@lo:103: 00010000:00010000:1.0:1789601351.084352:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601351.084365:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b7398db/0x74872e3eca9f114a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1143 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.084377:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601351.084417:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001483c09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:3647:x1876532918229120:12345-0@lo:103: Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.084424:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601351.084494:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522f5a64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918229120:0@lo:103: 00000020:01000000:0.0:1789601351.084503:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601351.084514:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601351.084517:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789601351.084522:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789601351.084525:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601351.084549:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000000725ca69) 00000020:00000080:0.0:1789601351.084589:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789601351.084596:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789601351.084897:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789601351.084907:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f1182 00000020:00000080:0.0:1789601351.085111:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789601351.085116:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601351.085120:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601351.085121:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789601351.085124:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601351.085127:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601351.085128:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789601351.085132:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601351.085139:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000004f5691d8) 00000020:00000080:0.0:1789601351.085150:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789601351.085153:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789601351.085154:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789601351.085156:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789601351.085162:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789601351.085217:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000049a79f98 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789601351.085229:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a41cdfbc) 00000020:00000080:0.0:1789601351.085246:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789601351.085317:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789601351.085323:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f1197 00000020:00000080:0.0:1789601351.085579:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789601351.085587:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789601351.085591:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x74872e3eca9f119e 00080000:01000000:0.0:1789601351.085597:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789601351.085600:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f11a5 00080000:10000000:0.0:1789601351.090219:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789601351.092989:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789601351.244353:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789601351.245648:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789601351.252026:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789601351.252656:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789601351.271145:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789601351.271157:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601351.271163:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601351.271165:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789601351.271172:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601351.271178:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601351.271179:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789601351.271183:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601351.271189:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:00000080:0.0:1789601351.271216:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601351.271230:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a40c2915) 00000020:00000080:0.0:1789601351.271252:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789601351.271258:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601351.271350:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789601351.271356:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789601351.271363:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f11b3 00010000:00080000:0.0:1789601351.271394:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c39d25cf@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789601351.273354:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789601351.276311:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789601351.276328:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789601351.276377:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789601351.276402:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f11ba 00000100:00080000:1.0:1789601351.276449:0:7466:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601351.276460:0:7466:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c39d25cf using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601351.276507:0:7466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a439dc03 x1876532918229248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601351.276588:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a439dc03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918229248:0@lo:38: 00000100:00100000:2.0:1789601351.276660:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.276782:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229248 00000100:00100000:0.0:1789601351.276792:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229248 00000100:00100000:0.0:1789601351.276853:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601351.276860:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db355402 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918229248:12345-0@lo:38: 00010000:00080000:0.0:1789601351.276887:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1789601351.276919:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f11c1 00000004:00100000:0.0:1789601351.276937:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789601351.276943:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789601351.281039:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789601351.281162:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601351.281170:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.281173:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789601351.281178:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789601351.281182:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789601351.281184:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601351.281186:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601351.281188:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789601351.281191:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.281193:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789601351.281195:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601351.281201:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1789601351.281205:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:1.0:1789601351.281205:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789601351.281211:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789601351.281233:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918229376:0@lo:400: 00000004:01000000:1.0:1789601351.281281:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789601351.281300:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601351.281305:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.281306:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789601351.281309:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601351.281312:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.281313:0:7466:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789601351.281316:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789601351.281318:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789601351.281347:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789601351.281352:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789601351.281355:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.281359:0:7466:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789601351.281364:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1789601351.281843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229376 00000100:00100000:3.0:1789601351.281853:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229376 00000100:00100000:3.0:1789601351.281906:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601351.281915:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056f8f942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918229376:12345-0@lo:400: 00000100:00100000:3.0:1789601351.281980:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056f8f942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918229376:12345-0@lo:400: Request processed in 66us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.281987:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789601351.282029:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000003d86edf x1876532918229376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601351.282061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918229376:0@lo:400: 00000020:01000000:0.0:1789601351.282655:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789601351.282698:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789601351.282719:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.282733:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000119d3218/0x74872e3eca9f116d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.282741:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4f8b56000 from 1 10000000:01000000:0.0:1789601351.282744:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601351.282782:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.282790:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.282801:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.283335:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bb32356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229504:0@lo:101: 00000100:00100000:0.0:1789601351.283404:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.283455:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533ccb23 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.283837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229504 00000100:00100000:2.0:1789601351.283846:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229504 00000100:00100000:2.0:1789601351.283906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601351.283914:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a503a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:7451:x1876532918229504:12345-0@lo:101: 00010000:00010000:2.0:1789601351.283938:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601351.283952:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f11c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.283977:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.283986:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.283995:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc3a31d1, rc 0) 00000100:00100000:2.0:1789601351.284052:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a503a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918229504:12345-0@lo:101: Request processed in 138us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.284058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789601351.284459:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bb32356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229504:0@lo:101: 00010000:00010000:3.0:1789601351.284476:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.284485:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.285781:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229632:0@lo:256: 00000100:00100000:3.0:1789601351.285856:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.285894:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000442dfcbb going to sleep for 11 seconds 00000100:00100000:0.0:1789601351.286067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229632 00000100:00100000:0.0:1789601351.286082:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229632 00000100:00100000:0.0:1789601351.286139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789601351.286146:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7cdbe23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918229632:12345-0@lo:256: 20000000:01000000:0.0:1789601351.286164:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789601351.286182:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789601351.286185:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789601351.286277:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7cdbe23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918229632:12345-0@lo:256: Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.286285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789601351.286408:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229632:0@lo:256: 10000000:01000000:3.0:1789601351.287343:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601351.287517:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.287530:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.289709:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f8b56000 from 1 10000000:01000000:0.0:1789601351.289718:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601351.289766:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.289778:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.289789:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.289828:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048353c2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229760:0@lo:101: 00000100:00100000:0.0:1789601351.289895:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.289943:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533ccb23 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.290109:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229760 00000100:00100000:3.0:1789601351.290119:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229760 00000100:00100000:3.0:1789601351.290174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789601351.290183:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f59274e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7451:x1876532918229760:12345-0@lo:101: 00010000:00010000:3.0:1789601351.290196:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601351.290207:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f11d6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.291268:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.291280:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.291289:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074bf418a, rc 0) 00000100:00100000:3.0:1789601351.291475:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f59274e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918229760:12345-0@lo:101: Request processed in 1292us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.291483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601351.291978:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048353c2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229760:0@lo:101: 00010000:00010000:1.0:1789601351.292000:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.292017:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.292210:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2bd02ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229888:0@lo:501: 00000100:00100000:0.0:1789601351.292387:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.292427:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533ccb23 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.292532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918229888 00000100:00100000:2.0:1789601351.292547:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918229888 00000100:00100000:2.0:1789601351.292654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601351.292663:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ae18839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918229888:12345-0@lo:501: 00000100:00100000:2.0:1789601351.292873:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ae18839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918229888:12345-0@lo:501: Request processed in 211us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.292881:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601351.292929:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2bd02ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918229888:0@lo:501: 00000100:00100000:0.0:1789601351.292966:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2bd02ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230016:0@lo:503: 00000100:00100000:0.0:1789601351.293016:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.293043:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533ccb23 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.293088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230016 00000100:00100000:3.0:1789601351.293094:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230016 00000100:00100000:3.0:1789601351.293135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789601351.293142:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f90c192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918230016:12345-0@lo:503: 00000040:00080000:3.0:1789601351.293187:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601351.293238:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f90c192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918230016:12345-0@lo:503: Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.293244:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601351.293318:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2bd02ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230016:0@lo:503: 00000040:00080000:1.0:1789601351.293598:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601351.293653:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789601351.293747:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601351.295173:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:0.0:1789601351.296624:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000ba20c19a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601351.296723:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db355402 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918229248:12345-0@lo:38: Request processed in 19860us (20062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.296735:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1789601351.297855:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789601351.297899:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601351.297916:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.297929:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601351.297984:0:7451:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789601351.297987:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4f8b56000 10000000:01000000:1.0:1789601351.297990:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4f8b56000 10000000:01000000:1.0:1789601351.297994:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601351.297999:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f8b56000 from 1 10000000:01000000:1.0:1789601351.298002:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601351.298039:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.298047:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.298057:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601351.298089:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab7203a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230144:0@lo:101: 00000100:00100000:1.0:1789601351.298143:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.298176:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032a2cdad going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.298306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230144 00000100:00100000:3.0:1789601351.298315:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230144 00000100:00100000:3.0:1789601351.298371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789601351.298382:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000087110be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7451:x1876532918230144:12345-0@lo:101: 00010000:00010000:3.0:1789601351.298394:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601351.298409:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a5caafa/0x74872e3eca9f11eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f11e4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.298409:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601351.298429:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789601351.298441:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00010000:00010000:3.0:1789601351.298446:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a5caafa/0x74872e3eca9f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789601351.298450:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789601351.298455:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000c39d25cf lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:3.0:1789601351.298472:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a5caafa/0x74872e3eca9f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.298479:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a439dc03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918229248:0@lo:38: 00010000:00010000:3.0:1789601351.298490:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a5caafa, rc 0) 00000100:00100000:3.0:1789601351.298589:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000087110be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230144:12345-0@lo:101: Request processed in 208us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.298593:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab7203a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230144:0@lo:101: 00000100:00100000:3.0:1789601351.298611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1789601351.298624:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.298639:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601351.298775:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001157357e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230272:0@lo:501: 00000100:00100000:2.0:1789601351.298853:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.298897:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147bdd4e going to sleep for 11 seconds 00000100:00100000:0.0:1789601351.298897:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918230400:0@lo:41: 00000100:00100000:0.0:1789601351.298948:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.299055:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230400 00000100:00100000:2.0:1789601351.299064:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230400 00000100:00100000:2.0:1789601351.299119:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601351.299122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230272 00000100:00100000:2.0:1789601351.299130:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000025ccf9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876532918230400:12345-0@lo:41: 00000100:00100000:3.0:1789601351.299131:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230272 00000100:00100000:3.0:1789601351.299168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789601351.299177:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f6d87a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230272:12345-0@lo:501: 00000004:00000024:2.0:1789601351.299184:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789601351.299265:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000025ccf9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876532918230400:12345-0@lo:41: Request processed in 137us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.299273:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601351.299327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f6d87a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230272:12345-0@lo:501: Request processed in 149us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.299336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601351.299352:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001157357e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230272:0@lo:501: 00000100:00100000:2.0:1789601351.299399:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001157357e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230528:0@lo:503: 00000100:00100000:2.0:1789601351.299449:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.299471:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147bdd4e going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.299582:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230528 00000100:00100000:1.0:1789601351.299589:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230528 00000100:00100000:1.0:1789601351.299617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789601351.299622:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a5331e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230528:12345-0@lo:503: 00000100:00100000:1.0:1789601351.299720:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a5331e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230528:12345-0@lo:503: Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.299727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789601351.299778:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001157357e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230528:0@lo:503: 00000040:00080000:1.0:1789601351.301938:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601351.302040:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac7245ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230656:0@lo:502: 00000100:00100000:1.0:1789601351.302114:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.302152:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032a2cdad going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.302195:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230656 00000100:00100000:2.0:1789601351.302211:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230656 00000100:00100000:2.0:1789601351.302297:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601351.302307:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b57b61e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230656:12345-0@lo:502: 00000100:00100000:0.0:1789601351.302328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918230400:0@lo:41: 00000100:00100000:2.0:1789601351.302743:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b57b61e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230656:12345-0@lo:502: Request processed in 435us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.302755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789601351.302764:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601351.302918:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac7245ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230656:0@lo:502: 00000040:00080000:3.0:1789601351.303444:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789601351.303485:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789601351.303623:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789601351.303642:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789601351.303656:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789601351.303670:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789601351.303685:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789601351.303698:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789601351.303712:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789601351.303725:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789601351.303739:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789601351.303753:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789601351.303768:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789601351.303799:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789601351.303826:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789601351.303842:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789601351.303855:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789601351.303869:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789601351.303883:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789601351.303897:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789601351.303911:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789601351.304334:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789601351.304355:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789601351.304369:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789601351.304800:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789601351.304831:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789601351.304846:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789601351.304860:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789601351.304916:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230784:0@lo:502: 00000100:00100000:3.0:1789601351.307360:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.307762:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013d0e9c2 going to sleep for 11 seconds 00000100:00100000:0.0:1789601351.308043:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230784 00000100:00100000:0.0:1789601351.308061:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230784 00000100:00100000:0.0:1789601351.308131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789601351.308141:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f27b3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230784:12345-0@lo:502: 00000100:00100000:0.0:1789601351.308315:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f27b3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918230784:12345-0@lo:502: Request processed in 175us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.308325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789601351.308373:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918230784:0@lo:502: 00000040:00080000:3.0:1789601351.308832:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789601351.308849:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789601351.313234:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789601351.314194:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000002ead46e9) 00000020:00000080:3.0:1789601351.314248:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789601351.314409:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000049a79f98 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789601351.314415:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000049a79f98 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789601351.314418:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000049a79f98 3 00010000:00080000:3.0:1789601351.314470:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b6fb1c39@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601351.316510:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789601351.319831:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789601351.320001:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601351.320020:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x74872e3eca9f11f9 00000100:00080000:3.0:1789601351.320034:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601351.320050:0:7472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b6fb1c39 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601351.320091:0:7472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003d86edf x1876532918230912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601351.320161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918230912:0@lo:38: 00000100:00100000:2.0:1789601351.320249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.320354:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918230912 00000100:00100000:1.0:1789601351.320362:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918230912 00000100:00100000:1.0:1789601351.320403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601351.320410:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039bfb43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918230912:12345-0@lo:38: 00010000:00080000:1.0:1789601351.320437:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1789601351.320478:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x74872e3eca9f1200 00000004:00100000:1.0:1789601351.320589:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601351.320630:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000be46f8ed : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789601351.323156:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789601351.329086:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039bfb43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876532918230912:12345-0@lo:38: Request processed in 8662us (8824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.329121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789601351.329630:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000003d86edf x1876532918230912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601351.329645:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601351.329656:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789601351.329667:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789601351.329673:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789601351.329676:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000b6fb1c39 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789601351.329683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d86edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918230912:0@lo:38: 00000040:00080000:3.0:1789601351.330473:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789601351.330794:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1789601351.331642:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789601351.331689:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601351.331712:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.331727:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000e64cbe05/0x74872e3eca9f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601351.331787:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601351.331795:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789601351.331797:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601351.331798:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601351.331799:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601351.331801:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601351.331802:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601351.331804:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601351.331805:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601351.331807:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601351.331809:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601351.331825:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789601351.331828:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601351.331830:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789601351.331831:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601351.331831:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601351.331832:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601351.331833:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601351.331834:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601351.331835:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601351.331836:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601351.331837:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601351.331838:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601351.331867:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789601351.331888:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918231040:0@lo:253: 00000100:00100000:0.0:1789601351.331983:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.332025:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9969c3c going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.332167:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231040 00000100:00100000:2.0:1789601351.332177:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231040 00000100:00100000:2.0:1789601351.332244:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789601351.332253:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6667394 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918231040:12345-0@lo:253: 20000000:01000000:2.0:1789601351.332289:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789601351.332307:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789601351.334499:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789601351.334674:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789601351.334692:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789601351.334843:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789601351.334850:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789601351.334876:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.334896:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.334903:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.334910:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.334962:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.334978:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.334992:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ffdc9fbe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918231168:0@lo:104: 00000100:00100000:3.0:1789601351.335035:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.335058:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6667394 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7451:x1876532918231040:12345-0@lo:253: Request processed in 2806us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.335071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1789601351.335135:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.335143:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.335151:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918231296:0@lo:104: 00000100:00100000:0.0:1789601351.335164:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7451:1876532918231040:0@lo:253: 00000100:00100000:3.0:1789601351.335171:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789601351.335179:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789601351.335182:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601351.335184:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789601351.335185:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601351.335187:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601351.335188:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601351.335189:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601351.335190:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601351.335192:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601351.335194:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601351.335204:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601351.335206:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601351.335221:0:7451:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789601351.337061:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a37b3745 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.338093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231168 00000100:00100000:1.0:1789601351.338108:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231168 00000100:00100000:1.0:1789601351.338226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231296 00000100:00100000:1.0:1789601351.338230:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231296 00000100:00100000:2.0:1789601351.339010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601351.339027:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002abc99dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918231168:12345-0@lo:104: 00010000:00010000:2.0:1789601351.339049:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.339174:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601351.339181:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002abc99dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918231168:12345-0@lo:104: Request processed in 161us (4146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.339188:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601351.339210:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601351.339216:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000388b7d7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918231296:12345-0@lo:104: 00010000:00010000:2.0:1789601351.339224:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.339261:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601351.339265:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000388b7d7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918231296:12345-0@lo:104: Request processed in 50us (4093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.339271:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789601351.340271:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601351.340281:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340291:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bad19c8c already unused, calling callback (000000006971bf21) 10000000:00010000:0.0:1789601351.340295:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340304:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601351.340311:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.340318:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601351.340367:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340374:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601351.340392:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340399:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f11c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11cf expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340420:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601351.340422:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340453:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001815d4fb already unused, calling callback (000000006971bf21) 10000000:00010000:0.0:1789601351.340456:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340462:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601351.340468:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.340473:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601351.340487:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340493:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601351.340510:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340517:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 000000001815d4fb/0x74872e3eca9f1120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1127 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.340532:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601351.340534:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601351.340536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601351.340593:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918231424:0@lo:103: 00000100:00100000:0.0:1789601351.340670:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.340737:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb644dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918231552:0@lo:103: 00000100:00100000:0.0:1789601351.340766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.341062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231424 00000100:00100000:3.0:1789601351.341067:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ffdc9fbe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918231168:0@lo:104: 00000100:00100000:0.0:1789601351.341070:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231424 00000100:00100000:3.0:1789601351.341079:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918231296:0@lo:104: 00010000:00010000:0.0:1789601351.341097:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601351.341104:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.341122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231552 00000100:00100000:0.0:1789601351.341125:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231552 00010000:00010000:0.0:1789601351.341135:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 16 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.341154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601351.341161:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000441370e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3646:x1876532918231424:12345-0@lo:103: 00010000:00010000:0.0:1789601351.341174:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601351.341180:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341190:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341206:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc3a31d1/0x74872e3eca9f11cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f11c8 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341218:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601351.341262:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000441370e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3646:x1876532918231424:12345-0@lo:103: Request processed in 101us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.341269:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601351.341286:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601351.341291:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e942e31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3647:x1876532918231552:12345-0@lo:103: 00010000:00010000:0.0:1789601351.341299:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601351.341302:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341318:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341327:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000376977e9/0x74872e3eca9f1127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1120 expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341339:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341348:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789601351.341364:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014887876s 00010000:00010000:0.0:1789601351.341369:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341375:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341381:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341387:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341393:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000930f6bde already unused, calling callback (00000000a9eeee50) 00010000:00010000:0.0:1789601351.341396:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341404:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341426:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341436:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601351.341442:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f479db47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918231424:0@lo:103: 00000100:00100000:0.0:1789601351.341461:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e942e31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3647:x1876532918231552:12345-0@lo:103: Request processed in 171us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.341468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601351.341531:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb644dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918231552:0@lo:103: 00010000:00010000:0.0:1789601351.341548:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341896:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.341904:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000930f6bde/0x74872e3eca9f1207 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.342023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789601351.343877:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.344306:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789601351.344753:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.345043:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789601351.345255:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.345429:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789601351.346700:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.347285:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789601351.347484:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.347870:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789601351.348157:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1789601351.348341:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789601351.350447:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789601351.351060:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789601351.351126:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb644dc4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876532918231680:0@lo:700: 00000100:00100000:0.0:1789601351.351225:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.351287:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231680 00000100:00100000:0.0:1789601351.351295:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231680 00000100:00100000:0.0:1789601351.351341:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601351.351349:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b94b7be pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1876532918231680:12345-0@lo:700: 00000100:00100000:0.0:1789601351.351473:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c980e1 going to sleep for 11 seconds 00000020:00080000:2.0:1789601351.351666:0:7477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789601351.351678:0:7477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789601351.351844:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789601351.352337:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918231808:0@lo:1000: 00000100:00100000:0.0:1789601351.352389:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.352420:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036ac1c3d going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.352476:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231808 00000100:00100000:2.0:1789601351.352483:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231808 00000100:00100000:2.0:1789601351.352621:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601351.352630:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000441370e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918231808:12345-0@lo:1000: 00000100:00100000:2.0:1789601351.352726:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000441370e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918231808:12345-0@lo:1000: Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.352734:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601351.352845:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001483c09 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918231808:0@lo:1000: 00000040:01000000:1.0:1789601351.352886:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789601351.352915:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac9dc466 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918231936:0@lo:700: 00000100:00100000:1.0:1789601351.353026:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.353053:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d47467 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.353215:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918231936 00000100:00100000:2.0:1789601351.353221:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918231936 00000100:00100000:2.0:1789601351.353256:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601351.353262:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d6061770 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918231936:12345-0@lo:700: 00000100:00100000:2.0:1789601351.353386:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d6061770 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918231936:12345-0@lo:700: Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.353393:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1789601351.354259:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789601351.354404:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789601351.355073:0:7451:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1789601351.355301:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac9dc466 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918231936:0@lo:700: 00000040:01000000:2.0:1789601351.355373:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789601351.355676:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601351.357788:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789601351.358775:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789601351.358839:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 40000000:02000000:0.0:1789601351.359226:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:2.0:1789601351.363633:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789601351.365510:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1789601351.366274:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b94b7be pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1876532918231680:12345-0@lo:700: Request processed in 14919us (15044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.366290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1789601351.367216:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789601351.367617:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789601351.367767:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789601351.368409:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789601351.368902:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789601351.369288:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:2.0:1789601351.371069:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0e77a1e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1876532918232064:0@lo:900: 00000100:00100000:2.0:1789601351.371161:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789601351.371343:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fb644dc4 x1876532918231680/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789601367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601351.371361:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb644dc4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876532918231680:0@lo:700: 40000000:02000000:1.0:1789601351.371377:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:2.0:1789601351.372070:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a934e74 going to sleep for 11 seconds 00100000:10000000:2.0:1789601351.372220:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789601351.372543:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789601351.372746:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789601351.375355:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789601351.375714:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789601351.375880:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789601351.376681:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789601351.376859:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789601351.381779:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789601351.382404:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789601351.382851:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:3.0:1789601351.383089:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232064 00000100:00100000:3.0:1789601351.383104:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232064 00000100:00100000:3.0:1789601351.383171:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601351.383181:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d40b9374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1876532918232064:12345-0@lo:900: 00000100:00100000:3.0:1789601351.383315:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d40b9374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1876532918232064:12345-0@lo:900: Request processed in 136us (12154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.383322:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789601351.383419:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f0e77a1e x1876532918232064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601351.383450:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0e77a1e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1876532918232064:0@lo:900: 00000100:00100000:3.0:1789601351.383741:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232192:0@lo:1000: 00000100:00100000:3.0:1789601351.383794:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.383853:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232192 00000100:00100000:3.0:1789601351.383858:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232192 00000100:00100000:3.0:1789601351.383900:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601351.383906:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdc9fbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232192:12345-0@lo:1000: 00000100:00100000:3.0:1789601351.384053:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdc9fbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232192:12345-0@lo:1000: Request processed in 147us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.384059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601351.384089:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000074ced53 going to sleep for 11 seconds 00000100:00100000:3.0:1789601351.384104:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232192:0@lo:1000: 00000004:00080000:3.0:1789601351.384157:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009100475c with version 0 00000020:00100000:3.0:1789601351.384173:0:7479:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789601351.384179:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ce662e71 x1876532918232448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601351.384190:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232448:0@lo:1000: 00000100:00100000:3.0:1789601351.384215:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.384233:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232448 00000100:00100000:3.0:1789601351.384237:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232448 00000100:00100000:3.0:1789601351.384255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601351.384260:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f90bd2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232448:12345-0@lo:1000: 00000100:00100000:3.0:1789601351.384895:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b31ec93 going to sleep for 11 seconds 00100000:10000000:2.0:1789601351.385159:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789601351.387777:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789601351.388285:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789601351.388445:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000001:00080000:1.0:1789601351.391383:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1789601351.391856:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:3.0:1789601351.392781:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f90bd2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232448:12345-0@lo:1000: Request processed in 8515us (8559us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789601351.392806:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789601351.392913:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789601351.392927:0:7479:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789601351.392945:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce662e71 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232448:0@lo:1000: 00000100:00100000:2.0:1789601351.393058:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067264102 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232576:0@lo:1000: 00000100:00100000:2.0:1789601351.393099:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.393139:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b31ec93 going to sleep for 11 seconds 00000100:00100000:0.0:1789601351.396692:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232576 00000100:00100000:0.0:1789601351.396712:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232576 00000100:00100000:0.0:1789601351.396822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601351.396832:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049be4344 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232576:12345-0@lo:1000: 00000100:00100000:0.0:1789601351.397291:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049be4344 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1876532918232576:12345-0@lo:1000: Request processed in 461us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.397300:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601351.399502:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067264102 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1876532918232576:0@lo:1000: 00000040:00080000:2.0:1789601351.399580:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789601351.399631:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001b31ec93 with version 1 00000004:00080000:3.0:1789601351.400084:0:7468:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000052888338 version 1 rpc_version 1 00000020:00100000:3.0:1789601351.400121:0:7468:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789601351.400129:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ade62b18 x1876532918232832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601351.400151:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ade62b18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1876532918232832:0@lo:1000: 00000100:00100000:3.0:1789601351.400228:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.400272:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 000000009100475c going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.401714:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232832 00000100:00100000:1.0:1789601351.401728:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232832 00000100:00100000:1.0:1789601351.401776:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601351.401784:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acdd1071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876532918232832:12345-0@lo:1000: 00000040:00080000:3.0:1789601351.404615:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789601351.407302:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789601351.407973:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789601351.408145:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789601351.408293:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000040:00080000:2.0:1789601351.408349:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789601351.408460:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789601351.408522:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789601351.408697:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789601351.408883:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789601351.409082:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789601351.409239:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789601351.409390:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789601351.409627:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789601351.412141:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000040:00080000:2.0:1789601351.413828:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789601351.414018:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789601351.414024:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:1.0:1789601351.414910:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acdd1071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876532918232832:12345-0@lo:1000: Request processed in 13121us (14676us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789601351.414936:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789601351.415088:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789601351.415095:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789601351.415117:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ade62b18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1876532918232832:0@lo:1000: 00000001:00080000:0.0:1789601351.423242:0:7451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789601351.423296:0:7451:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa27c81db7988 00100000:10000000:0.0:1789601351.423307:0:7451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789601351.424383:0:7451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789601351.424422:0:7451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789601351.424446:0:7451:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789601351.424470:0:7451:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789601351.435655:0:7451:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601351.441064:0:7451:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789601352.325839:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601353.349794:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601354.374871:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601355.397955:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601355.762068:0:7722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789601356.424596:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601356.617468:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ade62b18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918232960:0@lo:400: 00000100:00100000:2.0:1789601356.617573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601356.617667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918232960 00000100:00100000:2.0:1789601356.617676:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918232960 00000100:00100000:2.0:1789601356.618280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601356.618302:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b6b3662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3648:x1876532918232960:12345-0@lo:400: 00000100:00100000:2.0:1789601356.618370:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b6b3662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3648:x1876532918232960:12345-0@lo:400: Request processed in 71us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601356.618377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601356.618522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ade62b18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918232960:0@lo:400: 00000100:00100000:2.0:1789601356.620834:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac9dc466 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918233088:0@lo:41: 00000100:00100000:2.0:1789601356.620899:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601356.622203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bccc7a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918233216:0@lo:400: 00000100:00100000:0.0:1789601356.622354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601356.623162:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233216 00000100:00100000:1.0:1789601356.623171:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233216 00000100:00100000:0.0:1789601356.623397:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233088 00000100:00100000:0.0:1789601356.623403:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233088 00000100:00100000:0.0:1789601356.623437:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601356.623446:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067264102 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918233088:12345-0@lo:41: 00000004:00000024:0.0:1789601356.623501:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789601356.623581:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067264102 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918233088:12345-0@lo:41: Request processed in 135us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601356.623614:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601356.624740:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac9dc466 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918233088:0@lo:41: 00000100:00100000:1.0:1789601356.624987:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601356.625001:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025f79961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918233216:12345-0@lo:400: 00000100:00100000:1.0:1789601356.625071:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025f79961 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918233216:12345-0@lo:400: Request processed in 77us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601356.625078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789601356.625116:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000bccc7a5 x1876532918233216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601356.625127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bccc7a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918233216:0@lo:400: 00000100:00100000:3.0:1789601356.626043:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601356.626058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000008538dfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918233344:0@lo:400: 00000100:00100000:3.0:1789601356.626104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601356.626141:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233344 00000100:00100000:3.0:1789601356.626148:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233344 00000100:00100000:3.0:1789601356.626196:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601356.626203:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bccc7a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918233344:12345-0@lo:400: 00000100:00100000:3.0:1789601356.626240:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bccc7a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918233344:12345-0@lo:400: Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601356.626247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789601356.626279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000008538dfa x1876532918233344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601356.626298:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000008538dfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918233344:0@lo:400: 00000020:00000004:1.0:1789601356.757420:0:7776:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601356.757868:0:7776:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789601357.448303:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601358.470330:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601359.493805:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601359.692518:0:7877:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601359.692791:0:7877:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789601360.524262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789601360.922666:0:7925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff719550f0 20000000:00000080:0.0:1789601360.922690:0:7925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df4f8c2fc00 uarg=0000000000000000 20000000:01000000:0.0:1789601360.922762:0:7925:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789601360.922772:0:7925:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789601360.922778:0:7925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789601360.922880:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789601360.922895:0:7925:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789601360.932208:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601360.932770:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789601360.932809:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789601360.932824:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789601360.932843:0:7925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789601360.932864:0:7925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.932891:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.932898:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.932904:0:7925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.933009:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.933026:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 12 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601360.933041:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be934d9b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876532918233472:0@lo:104: 00000100:00100000:2.0:1789601360.933131:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601360.933196:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.933204:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 12 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601360.933212:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b4c5b43 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876532918233600:0@lo:104: 00000100:00100000:2.0:1789601360.933231:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d02a5283 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.933341:0:7463:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789601360.933363:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.933392:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233472 00000100:00100000:3.0:1789601360.933400:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233472 00000100:00100000:3.0:1789601360.933457:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233600 00000100:00100000:3.0:1789601360.933460:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233600 00000100:00100000:3.0:1789601360.933475:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601360.933482:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006cc3379e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:7925:x1876532918233472:12345-0@lo:104: 00010000:00010000:3.0:1789601360.933497:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601360.933504:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601360.933512:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008538dfa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:7925:x1876532918233600:12345-0@lo:104: 00010000:00010000:0.0:1789601360.933520:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.933631:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789601360.933638:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006cc3379e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:7925:x1876532918233472:12345-0@lo:104: Request processed in 156us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.933644:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601360.933762:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be934d9b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876532918233472:0@lo:104: 00000100:00100000:2.0:1789601360.933771:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b4c5b43 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876532918233600:0@lo:104: 00010000:00010000:2.0:1789601360.933790:0:7925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.941764:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789601360.941793:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008538dfa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:7925:x1876532918233600:12345-0@lo:104: Request processed in 8274us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601360.941811:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789601360.941971:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601360.941980:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.941993:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5d3fca9 already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601360.941997:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942008:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601360.942016:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601360.942022:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601360.942089:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942118:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601360.942152:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942159:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000f5d3fca9/0x74872e3eca9f11d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11dd expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942176:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601360.942178:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942184:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c98b16cf already unused, calling callback (000000006971bf21) 10000000:00010000:1.0:1789601360.942186:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942193:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601360.942198:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601360.942203:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601360.942217:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942223:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601360.942237:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942243:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000c98b16cf/0x74872e3eca9f10e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f10ef expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.942275:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601360.942276:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601360.942278:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601360.942294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa85bede pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918233856:0@lo:103: 00000100:00100000:1.0:1789601360.942380:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601360.943031:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601360.943051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c924808c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918233728:0@lo:103: 00000100:00100000:3.0:1789601360.943095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789601360.943109:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789601360.943115:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4f8b56000 from 4 10000000:01000000:0.0:1789601360.943118:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601360.943151:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943161:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943180:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.943182:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233856 00000100:00100000:3.0:1789601360.943190:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233856 00000100:00100000:0.0:1789601360.943196:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052372c84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918233984:0@lo:101: 00010000:00010000:3.0:1789601360.943220:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 13 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601360.943227:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.943245:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.943256:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233728 00000100:00100000:3.0:1789601360.943259:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233728 00010000:00010000:3.0:1789601360.943271:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 14 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601360.943273:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918233984 00000100:00100000:0.0:1789601360.943277:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918233984 00000100:00100000:3.0:1789601360.943297:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601360.943301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601360.943304:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9f5ab76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3645:x1876532918233856:12345-0@lo:103: 00000100:00100000:0.0:1789601360.943306:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000379c8cec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918233984:12345-0@lo:101: 00010000:00010000:3.0:1789601360.943319:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601360.943324:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 15 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943334:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 15 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943349:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000baa65020/0x74872e3eca9f10ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f10e8 expref: 15 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943364:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601360.943396:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9f5ab76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3645:x1876532918233856:12345-0@lo:103: Request processed in 93us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.943403:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601360.943420:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601360.943425:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002abc99dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3648:x1876532918233728:12345-0@lo:103: 00010000:00010000:0.0:1789601360.943428:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601360.943432:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601360.943435:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 13 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943440:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000376977e9/0x74872e3eca9f121c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1215 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943443:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 13 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943452:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074bf418a/0x74872e3eca9f11dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f11d6 expref: 14 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943458:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000376977e9/0x74872e3eca9f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943469:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000376977e9/0x74872e3eca9f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943472:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943477:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000376977e9, rc 0) 00010000:00010000:3.0:1789601360.943478:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943490:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943506:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943512:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943518:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943524:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009addb3ac already unused, calling callback (00000000a9eeee50) 00010000:00010000:3.0:1789601360.943527:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943534:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943546:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.943574:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601360.943595:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002abc99dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:3648:x1876532918233728:12345-0@lo:103: Request processed in 170us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601360.943595:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000379c8cec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918233984:12345-0@lo:101: Request processed in 289us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601360.943601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601360.943609:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601360.943638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c924808c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918233728:0@lo:103: 00000100:00100000:0.0:1789601360.943638:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052372c84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918233984:0@lo:101: 00010000:00010000:0.0:1789601360.943651:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601360.943668:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601360.943715:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052372c84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234112:0@lo:256: 00000100:00100000:0.0:1789601360.943756:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.943784:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a1db137 going to sleep for 11 seconds 00000100:00100000:1.0:1789601360.943829:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa85bede pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918233856:0@lo:103: 00010000:00010000:2.0:1789601360.943922:0:7925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.943931:0:7925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.943936:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009addb3ac/0x74872e3eca9f120e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.948230:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234112 00000100:00100000:3.0:1789601360.948252:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234112 00000100:00100000:3.0:1789601360.948332:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789601360.948343:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003226b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918234112:12345-0@lo:256: 20000000:01000000:3.0:1789601360.948377:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789601360.948399:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789601360.948403:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789601360.948597:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003226b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918234112:12345-0@lo:256: Request processed in 256us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.948606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789601360.948668:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052372c84 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234112:0@lo:256: 10000000:01000000:3.0:1789601360.948731:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601360.948753:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.948765:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000bad19c8c/0x74872e3eca9f1215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601360.948776:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601360.948779:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f8b56000 from 1 10000000:01000000:3.0:1789601360.948782:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601360.948819:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f1223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.948826:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f1223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.948847:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f1223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.948868:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234240:0@lo:101: 00000100:00100000:3.0:1789601360.948906:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.948939:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f22b3a9 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.948954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234240 00000100:00100000:3.0:1789601360.948958:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234240 00000100:00100000:3.0:1789601360.948985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789601360.948991:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb7601c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+12:6519:x1876532918234240:12345-0@lo:101: 00010000:00010000:3.0:1789601360.949001:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601360.949015:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d54067d6/0x74872e3eca9f122a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1223 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.949037:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d54067d6/0x74872e3eca9f122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.949047:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d54067d6/0x74872e3eca9f122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.949056:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d54067d6, rc 0) 00000100:00100000:3.0:1789601360.949083:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb7601c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234240:12345-0@lo:101: Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.949090:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789601360.949119:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234240:0@lo:101: 00010000:00010000:3.0:1789601360.949130:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f1223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.949148:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000002af1d5ee/0x74872e3eca9f1223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.949212:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234368:0@lo:501: 00000100:00100000:3.0:1789601360.949237:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.949249:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f22b3a9 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.949259:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234368 00000100:00100000:3.0:1789601360.949262:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234368 00000100:00100000:3.0:1789601360.949282:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789601360.949287:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f024305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234368:12345-0@lo:501: 00000100:00100000:3.0:1789601360.949441:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f024305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234368:12345-0@lo:501: Request processed in 153us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.949449:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789601360.949478:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234368:0@lo:501: 00000100:00100000:3.0:1789601360.949507:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234496:0@lo:503: 00000100:00100000:3.0:1789601360.949551:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.949588:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f22b3a9 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.949599:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234496 00000100:00100000:3.0:1789601360.949603:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234496 00000100:00100000:3.0:1789601360.949622:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789601360.949628:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006479c771 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234496:12345-0@lo:503: 00000100:00100000:3.0:1789601360.949711:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006479c771 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234496:12345-0@lo:503: Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.949718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789601360.949771:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b7d7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234496:0@lo:503: 00000100:00100000:2.0:1789601360.971646:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b4c5b43 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7926:1876532918234624:0@lo:502: 00000100:00100000:2.0:1789601360.971775:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601360.971822:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc9a43ee going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.971954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234624 00000100:00100000:3.0:1789601360.971963:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234624 00000100:00100000:3.0:1789601360.972019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789601360.972027:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003bf7d998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7926:x1876532918234624:12345-0@lo:502: 00000100:00100000:3.0:1789601360.972176:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003bf7d998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7926:x1876532918234624:12345-0@lo:502: Request processed in 150us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.972184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789601360.973898:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b4c5b43 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7926:1876532918234624:0@lo:502: 00000020:01000000:2.0:1789601360.973948:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601360.973960:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601360.973962:0:7926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789601360.973972:0:7926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4f8b56000 00000020:00000080:2.0:1789601360.973975:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789601360.974040:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7926:1876532918234752:0@lo:502: 00000100:00100000:2.0:1789601360.974116:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601360.974170:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.974275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234752 00000100:00100000:3.0:1789601360.974282:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234752 00000100:00100000:3.0:1789601360.974339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601360.974348:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7926:x1876532918234752:12345-0@lo:502: 00000100:00100000:3.0:1789601360.974491:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:7926:x1876532918234752:12345-0@lo:502: Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.974499:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789601360.974715:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7926:1876532918234752:0@lo:502: 00000020:01000000:1.0:1789601360.974748:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601360.974754:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601360.974756:0:7926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789601360.974760:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789601360.974954:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789601360.974978:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601360.974990:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.975003:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601360.975013:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789601360.975017:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4d017d800 from 21 10000000:01000000:3.0:1789601360.975019:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601360.975050:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.975058:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.975077:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.975093:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234880:0@lo:101: 00000100:00100000:3.0:1789601360.975131:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.975161:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601360.975453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918234880 00000100:00100000:2.0:1789601360.975460:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918234880 00000100:00100000:2.0:1789601360.975507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601360.975514:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:6519:x1876532918234880:12345-0@lo:101: 00010000:00010000:2.0:1789601360.975525:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601360.975539:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1231 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.975590:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.975602:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.975612:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679c00, rc 0) 00000100:00100000:2.0:1789601360.977364:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918234880:12345-0@lo:101: Request processed in 1836us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601360.977384:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789601360.988970:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918234880:0@lo:101: 00010000:00010000:1.0:1789601360.989009:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.989026:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601360.989153:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235008:0@lo:501: 00000100:00100000:1.0:1789601360.989229:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601360.989287:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.989373:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235008 00000100:00100000:3.0:1789601360.989383:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235008 00000100:00100000:3.0:1789601360.989442:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789601360.989452:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918235008:12345-0@lo:501: 00000100:00100000:3.0:1789601360.989660:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918235008:12345-0@lo:501: Request processed in 208us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.989668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789601360.990894:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235008:0@lo:501: 00000100:00100000:0.0:1789601360.990970:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235136:0@lo:503: 00000100:00100000:0.0:1789601360.991063:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.991108:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.991166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235136 00000100:00100000:3.0:1789601360.991179:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235136 00000100:00100000:3.0:1789601360.991254:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789601360.991590:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918235136:12345-0@lo:503: 00000100:00100000:3.0:1789601360.991786:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918235136:12345-0@lo:503: Request processed in 523us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.991794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789601360.991921:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235136:0@lo:503: 00000100:00100000:0.0:1789601360.992326:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7928:1876532918235264:0@lo:502: 00000100:00100000:0.0:1789601360.992377:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.992406:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.993043:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235264 00000100:00100000:3.0:1789601360.993052:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235264 00000100:00100000:3.0:1789601360.993105:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601360.993115:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7928:x1876532918235264:12345-0@lo:502: 00000100:00100000:3.0:1789601360.993467:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7928:x1876532918235264:12345-0@lo:502: Request processed in 353us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601360.993710:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7928:1876532918235264:0@lo:502: 00000100:00100000:0.0:1789601360.993799:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7928:1876532918235392:0@lo:502: 00000100:00100000:0.0:1789601360.993849:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.993890:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601360.993946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235392 00000100:00100000:1.0:1789601360.993952:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235392 00000100:00100000:1.0:1789601360.993992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601360.993998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789601360.994000:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:7928:x1876532918235392:12345-0@lo:502: 00000100:00100000:1.0:1789601360.994118:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:7928:x1876532918235392:12345-0@lo:502: Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601360.994125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601360.994717:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7928:1876532918235392:0@lo:502: 00000040:00080000:3.0:1789601360.994755:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789601360.994835:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789601360.994860:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601360.994872:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.994885:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601360.994896:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789601360.994899:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4d017d800 from 4 10000000:01000000:1.0:1789601360.994903:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601360.994938:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.994947:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601360.994956:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601360.994974:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235520:0@lo:101: 00000100:00100000:1.0:1789601360.995016:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601360.995049:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94ccf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601360.995468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235520 00000100:00100000:3.0:1789601360.995477:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235520 00000100:00100000:3.0:1789601360.996031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601360.996041:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918235520:12345-0@lo:101: 00010000:00010000:3.0:1789601360.996058:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601360.996079:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f123f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.996105:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f123f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.996116:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f123f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.996125:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601360.996194:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918235520:12345-0@lo:101: Request processed in 155us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601360.996201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601360.996277:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235520:0@lo:101: 00010000:00010000:3.0:1789601360.996292:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601360.996302:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601360.998470:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235648:0@lo:256: 00000100:00100000:3.0:1789601360.998571:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.998617:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601360.998633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235648 00000100:00100000:2.0:1789601360.998641:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235648 00000100:00100000:2.0:1789601360.998699:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789601360.998710:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918235648:12345-0@lo:256: 20000000:01000000:2.0:1789601360.998732:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601360.998765:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601360.998769:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789601360.998864:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918235648:12345-0@lo:256: Request processed in 155us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601360.998872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789601360.998922:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235648:0@lo:256: 10000000:01000000:2.0:1789601360.998975:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601360.998985:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.998999:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601360.999021:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789601360.999024:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789601360.999027:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601360.999054:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999062:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999071:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601360.999085:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235776:0@lo:101: 00000100:00100000:2.0:1789601360.999109:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601360.999124:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601360.999138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235776 00000100:00100000:2.0:1789601360.999141:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235776 00000100:00100000:2.0:1789601360.999163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789601360.999170:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918235776:12345-0@lo:101: 00010000:00010000:2.0:1789601360.999179:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601360.999195:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f124d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999217:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f124d expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999230:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f124d expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999250:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679a00, rc 0) 00000100:00100000:2.0:1789601360.999280:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918235776:12345-0@lo:101: Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601360.999286:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789601360.999316:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235776:0@lo:101: 00010000:00010000:2.0:1789601360.999329:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601360.999339:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601360.999400:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235904:0@lo:501: 00000100:00100000:2.0:1789601360.999426:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601360.999438:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601360.999449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918235904 00000100:00100000:2.0:1789601360.999452:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918235904 00000100:00100000:2.0:1789601360.999472:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789601360.999478:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918235904:12345-0@lo:501: 00000100:00100000:2.0:1789601360.999797:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918235904:12345-0@lo:501: Request processed in 318us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601360.999805:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789601360.999836:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918235904:0@lo:501: 00000100:00100000:2.0:1789601360.999865:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918236032:0@lo:503: 00000100:00100000:2.0:1789601360.999909:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601360.999932:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601360.999949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236032 00000100:00100000:2.0:1789601360.999953:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236032 00000100:00100000:2.0:1789601360.999974:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789601360.999980:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918236032:12345-0@lo:503: 00000100:00100000:2.0:1789601361.000062:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918236032:12345-0@lo:503: Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.000069:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789601361.000105:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918236032:0@lo:503: 00000100:00100000:1.0:1789601361.007965:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7930:1876532918236160:0@lo:502: 00000100:00100000:1.0:1789601361.008066:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.008118:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601361.008181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236160 00000100:00100000:2.0:1789601361.008189:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236160 00000100:00100000:2.0:1789601361.008248:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789601361.008259:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:7930:x1876532918236160:12345-0@lo:502: 00000100:00100000:2.0:1789601361.008420:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:7930:x1876532918236160:12345-0@lo:502: Request processed in 162us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.008429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789601361.010714:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7930:1876532918236160:0@lo:502: 00000020:01000000:0.0:1789601361.010779:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601361.010795:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601361.010797:0:7930:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789601361.010803:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601361.010808:0:7930:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:00000080:0.0:1789601361.010844:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601361.010876:0:7930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8df4f72699c0) 00000020:00000080:0.0:1789601361.010902:0:7930:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789601361.010909:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601361.011027:0:7930:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789601361.011034:0:7930:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789601361.011042:0:7930:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f1262 00010000:00080000:0.0:1789601361.011075:0:7930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f7157000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789601361.017440:0:7930:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789601361.019360:0:7930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601361.019376:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789601361.019420:0:7930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789601361.019447:0:7930:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f1269 00000100:00080000:0.0:1789601361.019460:0:7930:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601361.019472:0:7930:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4f7157000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601361.019520:0:7930:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4f8ab0380 x1876532918236288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601361.019613:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918236288:0@lo:38: 00000100:00100000:2.0:1789601361.019837:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601361.020009:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236288 00000100:00100000:3.0:1789601361.020019:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236288 00000100:00100000:3.0:1789601361.020077:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601361.020090:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918236288:12345-0@lo:38: 00010000:00080000:3.0:1789601361.020120:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1789601361.020159:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f1270 00000004:00100000:3.0:1789601361.020187:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789601361.020193:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789601361.020518:0:7930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1789601361.021498:0:7930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1789601361.022104:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918236416:0@lo:400: 00000100:00100000:3.0:1789601361.022262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601361.022334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236416 00000100:00100000:0.0:1789601361.022342:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236416 00000100:00100000:0.0:1789601361.022398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601361.022409:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918236416:12345-0@lo:400: 00000100:00100000:0.0:1789601361.022810:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918236416:12345-0@lo:400: Request processed in 402us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.022819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601361.023327:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918236544:0@lo:400: 00000100:00100000:2.0:1789601361.023415:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.023442:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601361.023448:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918236672:0@lo:400: 00000100:00100000:2.0:1789601361.023470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.023501:0:6527:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789601361.023510:0:6527:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789601361.023525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236672 00000100:00100000:2.0:1789601361.023530:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236672 00000100:00100000:2.0:1789601361.023588:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601361.023606:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918236672:12345-0@lo:400: 00000100:00100000:2.0:1789601361.023648:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918236672:12345-0@lo:400: Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.023655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789601361.023704:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4d09c6a00 x1876532918236672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601361.023718:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918236672:0@lo:400: 00010000:00080000:3.0:1789601361.027814:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4d09c5c00 x1876532918236416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601361.027835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918236416:0@lo:400: 00000100:00100000:2.0:1789601361.028387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236544 00000100:00100000:2.0:1789601361.028395:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236544 00000100:00080000:1.0:1789601361.029135:0:7933:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8df4cd0b9f80 x1876532918236800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601361.029152:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc3c0 going to sleep for 0 seconds 00000020:01000000:3.0:1789601361.029300:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601361.029310:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789601361.029310:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000020:00000080:3.0:1789601361.029316:0:7930:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789601361.029324:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601361.029330:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601361.029335:0:7930:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000100:00100000:1.0:1789601361.029336:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918236544:12345-0@lo:400: 00000020:00000080:3.0:1789601361.029345:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601361.029349:0:7930:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789601361.029404:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7930:1876532918236928:0@lo:502: 00000100:00100000:2.0:1789601361.030433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918236544:0@lo:400: 00000100:00080000:2.0:1789601361.032833:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8df4f8d3d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601361.036610:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918236544:12345-0@lo:400: Request processed in 7225us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601361.036630:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789601361.037482:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601361.037605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236928 00000100:00100000:3.0:1789601361.037615:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236928 00000100:00100000:3.0:1789601361.037669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601361.037680:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:7930:x1876532918236928:12345-0@lo:502: 00000100:00100000:3.0:1789601361.037838:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:7930:x1876532918236928:12345-0@lo:502: Request processed in 160us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601361.037846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601361.037905:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601361.037933:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7930:1876532918236928:0@lo:502: 00000020:01000000:3.0:1789601361.037973:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601361.037980:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601361.037982:0:7930:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789601361.037987:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789601361.038614:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789601361.038636:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789601361.038646:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.038659:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601361.038668:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601361.038671:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4d017d800 from 1 10000000:01000000:3.0:1789601361.038674:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601361.038709:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.038717:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.038734:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601361.038765:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237056:0@lo:101: 00000100:00100000:3.0:1789601361.038811:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601361.038840:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601361.039232:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918236288:12345-0@lo:38: Request processed in 19143us (19394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.039243:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601361.039274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237056 00000100:00100000:2.0:1789601361.039280:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237056 00000100:00100000:2.0:1789601361.039319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601361.039326:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918237056:12345-0@lo:101: 00010000:00010000:2.0:1789601361.039336:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601361.039349:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.039374:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.039385:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.039405:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678600, rc 0) 00000100:00100000:2.0:1789601361.039445:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918237056:12345-0@lo:101: Request processed in 119us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.039451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601361.039488:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237056:0@lo:101: 00010000:00010000:2.0:1789601361.039502:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.039511:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601361.039591:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237184:0@lo:501: 00000100:00100000:2.0:1789601361.039616:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.039636:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601361.039647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237184 00000100:00100000:2.0:1789601361.039651:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237184 00000100:00100000:2.0:1789601361.039671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789601361.039677:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918237184:12345-0@lo:501: 00000100:00100000:2.0:1789601361.039783:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918237184:12345-0@lo:501: Request processed in 105us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.039790:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789601361.039819:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237184:0@lo:501: 00000100:00100000:2.0:1789601361.039846:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237312:0@lo:503: 00000100:00100000:2.0:1789601361.039881:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.039893:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601361.039910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237312 00000100:00100000:2.0:1789601361.039914:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237312 00000100:00100000:2.0:1789601361.039933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789601361.039939:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918237312:12345-0@lo:503: 00000100:00100000:2.0:1789601361.040018:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918237312:12345-0@lo:503: Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.040025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789601361.040062:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918237312:0@lo:503: 00000100:00100000:3.0:1789601361.040249:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601361.040259:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789601361.040267:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789601361.040272:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789601361.040277:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7157000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789601361.040291:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000921ebc2f): req@ffff8df4cd0b9f80 x1876532918236800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601361.040310:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918236288:0@lo:38: 00000100:00100000:0.0:1789601361.040548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918237440:0@lo:41: 00000100:00100000:0.0:1789601361.040604:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.040836:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.040890:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601361.048028:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237440 00000100:00100000:0.0:1789601361.048045:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237440 00000100:00100000:0.0:1789601361.048150:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918236800 00000100:00100000:0.0:1789601361.048154:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918236800 00000100:00100000:0.0:1789601361.048173:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601361.048182:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918237440:12345-0@lo:41: 00000004:00000024:0.0:1789601361.048218:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789601361.048300:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918237440:12345-0@lo:41: Request processed in 119us (7696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.048307:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601361.048361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918237440:0@lo:41: 00000100:00100000:0.0:1789601361.048391:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601361.048397:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918236800:12345-0@lo:1000: 00000100:00100000:2.0:1789601361.050607:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7936:1876532918237568:0@lo:502: 00000100:00100000:2.0:1789601361.050677:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.050712:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237568 00000100:00100000:2.0:1789601361.050720:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237568 00000100:00100000:2.0:1789601361.050772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789601361.050780:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:7936:x1876532918237568:12345-0@lo:502: 00000100:00100000:2.0:1789601361.050895:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:7936:x1876532918237568:12345-0@lo:502: Request processed in 114us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.050902:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789601361.050960:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601361.050984:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7936:1876532918237568:0@lo:502: 00000020:01000000:2.0:1789601361.051015:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601361.051025:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601361.051028:0:7936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789601361.051035:0:7936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4d017d800 00000020:00000080:2.0:1789601361.051038:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789601361.051060:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7936:1876532918237696:0@lo:502: 00000100:00100000:2.0:1789601361.051091:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.051113:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66f4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601361.053903:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918236800:12345-0@lo:1000: Request processed in 5497us (13057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.053918:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601361.053957:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237696 00000100:00100000:0.0:1789601361.053967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237696 00000100:00100000:0.0:1789601361.054130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789601361.054140:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:7936:x1876532918237696:12345-0@lo:502: 00000100:00100000:0.0:1789601361.054295:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:7936:x1876532918237696:12345-0@lo:502: Request processed in 157us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.054303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601361.054498:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918236800:0@lo:1000: 00000040:01000000:1.0:1789601361.054537:0:7933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789601361.054617:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918237824:0@lo:1000: 00000100:00100000:1.0:1789601361.054659:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.054692:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601361.054705:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237824 00000100:00100000:1.0:1789601361.054710:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237824 00000100:00100000:1.0:1789601361.054738:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601361.054757:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918237824:12345-0@lo:1000: 00000100:00100000:1.0:1789601361.054875:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918237824:12345-0@lo:1000: Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601361.054881:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601361.054911:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918237824:0@lo:1000: 00000100:00100000:1.0:1789601361.054948:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918237952:0@lo:700: 00000100:00100000:1.0:1789601361.054971:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.054988:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601361.055012:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918237952 00000100:00100000:1.0:1789601361.055016:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918237952 00000100:00100000:1.0:1789601361.055043:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601361.055050:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918237952:12345-0@lo:700: 00000100:00100000:1.0:1789601361.055091:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918237952:12345-0@lo:700: Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601361.055096:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601361.055122:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918237952:0@lo:700: 00000100:00100000:1.0:1789601361.055258:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238080:0@lo:1000: 00000100:00100000:1.0:1789601361.055281:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.055297:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601361.055364:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238080 00000100:00100000:1.0:1789601361.055368:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238080 00000100:00100000:1.0:1789601361.055390:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601361.055396:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918238080:12345-0@lo:1000: 00000100:00100000:1.0:1789601361.055444:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918238080:12345-0@lo:1000: Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601361.055450:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601361.055475:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238080:0@lo:1000: 00000004:00080000:1.0:1789601361.055510:0:7933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8df4d94ccb40 with version 0 00000020:00100000:1.0:1789601361.055523:0:7933:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789601361.055531:0:7933:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8df4cd0b9f80 x1876532918238336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601361.055544:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238336:0@lo:1000: 00000100:00100000:1.0:1789601361.055589:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.055603:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601361.055621:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238336 00000100:00100000:1.0:1789601361.055625:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238336 00000100:00100000:1.0:1789601361.055646:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601361.055652:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1876532918238336:12345-0@lo:1000: 00000100:00100000:3.0:1789601361.058682:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:7936:1876532918237696:0@lo:502: 00000020:01000000:3.0:1789601361.058731:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601361.058738:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601361.058751:0:7936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789601361.058756:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789601361.058927:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789601361.058952:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601361.058964:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.058977:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601361.058986:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789601361.058988:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f3720000 from 1 10000000:01000000:2.0:1789601361.058991:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789601361.059029:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.059038:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601361.059048:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601361.059068:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918238464:0@lo:101: 00000100:00100000:2.0:1789601361.059128:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.059347:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fd80 going to sleep for 11 seconds 00000001:00080000:1.0:1789601361.061869:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789601361.061881:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789601361.062048:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7933:x1876532918238336:12345-0@lo:1000: Request processed in 6392us (6454us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789601361.062059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789601361.062142:0:7933:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789601361.062147:0:7933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789601361.062164:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238336:0@lo:1000: 00000100:00100000:1.0:1789601361.062259:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238592:0@lo:1000: 00000100:00100000:1.0:1789601361.062294:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.062323:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601361.062419:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238592 00000100:00100000:0.0:1789601361.062426:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238592 00000100:00100000:0.0:1789601361.062472:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601361.062487:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7933:x1876532918238592:12345-0@lo:1000: 00000100:00100000:0.0:1789601361.062579:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7933:x1876532918238592:12345-0@lo:1000: Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.062586:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601361.062659:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1876532918238592:0@lo:1000: 00000040:00080000:1.0:1789601361.062675:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789601361.062703:0:7933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8df4d94ccb40 with version 1 00000004:00080000:0.0:1789601361.063280:0:7931:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8df4d80a43c0 version 1 rpc_version 1 00000020:00100000:0.0:1789601361.063300:0:7931:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789601361.063309:0:7931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8df4f8ab1500 x1876532918238848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601361.063325:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7931:1876532918238848:0@lo:1000: 00000100:00100000:0.0:1789601361.063360:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601361.063379:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601361.063393:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238848 00000100:00100000:0.0:1789601361.063399:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238848 00000100:00100000:0.0:1789601361.063426:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601361.063432:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7931:x1876532918238848:12345-0@lo:1000: 00000100:00100000:3.0:1789601361.064858:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238464 00000100:00100000:3.0:1789601361.064868:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238464 00000040:00080000:1.0:1789601361.066370:0:7933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789601361.066446:0:7933:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789601361.066451:0:7933:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789601361.067218:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789601361.067237:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918238464:12345-0@lo:101: 00010000:00010000:3.0:1789601361.067257:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601361.067279:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.067327:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.067339:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601361.067349:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528c00, rc 0) 00000100:00100000:3.0:1789601361.067438:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918238464:12345-0@lo:101: Request processed in 210us (8310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601361.067445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601361.067544:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918238464:0@lo:101: 00010000:00010000:1.0:1789601361.067580:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601361.067591:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601361.067671:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918238976:0@lo:501: 00000100:00100000:1.0:1789601361.067708:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601361.068482:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601361.068544:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918238976 00000100:00100000:0.0:1789601361.068552:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918238976 00000100:00100000:0.0:1789601361.068623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789601361.068631:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918238976:12345-0@lo:501: 00000100:00100000:0.0:1789601361.068718:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918238976:12345-0@lo:501: Request processed in 88us (1009us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601361.068726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789601361.068827:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918238976:0@lo:501: 10000000:01000000:1.0:1789601361.068860:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601361.068867:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601361.068876:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601361.072273:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789601361.072450:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7931:x1876532918238848:12345-0@lo:1000: Request processed in 9012us (9084us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789601361.072463:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1789601361.072638:0:7931:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789601361.072644:0:7931:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789601361.072665:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7931:1876532918238848:0@lo:1000: 00010000:00010000:1.0:1789601361.542766:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601361.734649:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601361.734676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918239104:0@lo:41: 00000100:00100000:0.0:1789601361.734765:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.734947:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239104 00000100:00100000:2.0:1789601361.734957:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239104 00000100:00100000:2.0:1789601361.735016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601361.735027:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918239104:12345-0@lo:41: 00000004:00000024:2.0:1789601361.735064:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789601361.735511:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918239104:12345-0@lo:41: Request processed in 484us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.735527:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601361.735652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918239104:0@lo:41: 00010000:00010000:0.0:1789601362.572364:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601363.592934:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601364.614807:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601365.637861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601366.341819:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601366.341846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918239232:0@lo:41: 00000100:00100000:3.0:1789601366.341915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601366.342019:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239232 00000100:00100000:0.0:1789601366.342030:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239232 00000100:00100000:0.0:1789601366.342086:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601366.342096:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918239232:12345-0@lo:41: 00000004:00000024:0.0:1789601366.342135:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789601366.342185:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918239232:12345-0@lo:41: Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601366.342192:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601366.342251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918239232:0@lo:41: 00000100:00100000:0.0:1789601366.344518:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918239488:0@lo:400: 00000100:00100000:3.0:1789601366.344810:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918239360:0@lo:400: 00000100:00100000:0.0:1789601366.344846:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601366.344901:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918239744:0@lo:400: 00000100:00100000:3.0:1789601366.344954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601366.345595:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601366.345603:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918239616:0@lo:400: 00000100:00100000:0.0:1789601366.345637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601366.345685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239488 00000100:00100000:0.0:1789601366.345693:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239488 00000100:00100000:0.0:1789601366.345752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601366.345762:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918239488:12345-0@lo:400: 00000100:00100000:0.0:1789601366.345816:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918239488:12345-0@lo:400: Request processed in 55us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601366.345823:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601366.345846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239360 00000100:00100000:0.0:1789601366.345850:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239360 00000100:00100000:0.0:1789601366.345871:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789601366.345888:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3648:x1876532918239360:12345-0@lo:400: 00000100:00100000:0.0:1789601366.345921:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3648:x1876532918239360:12345-0@lo:400: Request processed in 34us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601366.345928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789601366.345972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918239360:0@lo:400: 00010000:00080000:0.0:1789601366.346038:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4f8ab3b80 x1876532918239488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601366.346050:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918239488:0@lo:400: 00000100:00100000:2.0:1789601366.346392:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239616 00000100:00100000:2.0:1789601366.346398:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239616 00000100:00100000:2.0:1789601366.346431:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601366.346438:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918239616:12345-0@lo:400: 00000100:00100000:2.0:1789601366.346490:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918239616:12345-0@lo:400: Request processed in 52us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601366.346496:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601366.346601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918239616:0@lo:400: 00000100:00100000:1.0:1789601366.348031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601366.350861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239744 00000100:00100000:2.0:1789601366.350875:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239744 00000100:00100000:2.0:1789601366.350937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601366.350948:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918239744:12345-0@lo:400: 00000100:00100000:2.0:1789601366.351043:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918239744:12345-0@lo:400: Request processed in 96us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601366.351051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789601366.351192:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4f8ab0000 x1876532918239744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601366.351210:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918239744:0@lo:400: 00010000:00010000:3.0:1789601366.662747:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601366.855399:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918239872:0@lo:41: 00000100:00100000:0.0:1789601366.855472:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601366.855740:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918239872 00000100:00100000:3.0:1789601366.855758:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918239872 00000100:00100000:3.0:1789601366.855821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789601366.855831:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918239872:12345-0@lo:41: 00000004:00000024:3.0:1789601366.855874:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789601366.855927:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918239872:12345-0@lo:41: Request processed in 97us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601366.855935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789601366.855993:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918239872:0@lo:41: 00010000:00010000:2.0:1789601367.687917:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601368.711537:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601369.734903:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601370.759109:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789601371.133977:0:8432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789601371.133983:0:8432:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789601371.133985:0:8432:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789601371.134136:0:8432:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df4f70a3000 00000020:01000004:3.0:1789601371.134156:0:8432:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789601371.134172:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789601371.134201:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df4f7350000) 00000020:00000080:3.0:1789601371.134222:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789601371.201243:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789601371.201314:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789601371.251946:0:8432:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789601371.252217:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789601371.252234:0:8432:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789601371.252251:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74872e3eca9f129a 00000020:01000004:1.0:1789601371.252264:0:8432:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789601371.252297:0:8432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789601371.252302:0:8432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789601371.252310:0:8432:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789601371.252316:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789601371.252363:0:8432:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df4f763cd40) 00000020:00000080:1.0:1789601371.252379:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789601371.254225:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601371.254452:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789601371.254460:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789601371.263796:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789601371.263819:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789601371.266987:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789601371.267005:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789601371.271204:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601371.271469:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789601371.271476:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789601371.277970:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789601371.277985:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789601371.330205:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601371.331426:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601371.331439:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789601371.339149:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789601371.339174:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789601371.346139:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789601371.346166:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789601371.350465:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601371.355097:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789601371.355108:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789601371.355931:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601371.355941:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789601371.461781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918240128:0@lo:400: 00000100:00100000:0.0:1789601371.461847:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.461906:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789601371.461912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918240000:0@lo:400: 00000100:00100000:0.0:1789601371.461936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.461956:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918240512:0@lo:400: 00000100:00100000:0.0:1789601371.461973:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.461998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240128 00000100:00100000:0.0:1789601371.462005:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240128 00000100:00100000:0.0:1789601371.462051:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601371.462059:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918240128:12345-0@lo:400: 00000100:00100000:0.0:1789601371.462110:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918240128:12345-0@lo:400: Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.462126:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601371.462150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240000 00000100:00100000:0.0:1789601371.462153:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240000 00000100:00100000:0.0:1789601371.462176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601371.462182:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3646:x1876532918240000:12345-0@lo:400: 00000100:00100000:0.0:1789601371.462215:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3646:x1876532918240000:12345-0@lo:400: Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.462221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601371.462246:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240512 00000100:00100000:0.0:1789601371.462250:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240512 00000100:00100000:0.0:1789601371.462271:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601371.462276:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918240512:12345-0@lo:400: 00000100:00100000:0.0:1789601371.462306:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918240512:12345-0@lo:400: Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.462312:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601371.462353:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918240000:0@lo:400: 00000100:00100000:0.0:1789601371.462363:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918240512:0@lo:400: 00010000:00080000:0.0:1789601371.462386:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4f8ab0000 x1876532918240128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601371.462395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918240128:0@lo:400: 00000100:00100000:0.0:1789601371.462441:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918240384:0@lo:400: 00000100:00100000:0.0:1789601371.462464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.462482:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601371.462486:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918240256:0@lo:400: 00000100:00100000:0.0:1789601371.462501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.462531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240384 00000100:00100000:0.0:1789601371.462535:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240384 00000100:00100000:0.0:1789601371.462578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601371.462585:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918240384:12345-0@lo:400: 00000100:00100000:0.0:1789601371.462617:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918240384:12345-0@lo:400: Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.462623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601371.462638:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240256 00000100:00100000:0.0:1789601371.462641:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240256 00000100:00100000:0.0:1789601371.462661:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601371.462677:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918240256:12345-0@lo:400: 00000100:00100000:0.0:1789601371.462703:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918240256:12345-0@lo:400: Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.462708:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601371.462729:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918240256:0@lo:400: 00010000:00080000:0.0:1789601371.462738:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4f8ab1500 x1876532918240384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601371.462746:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918240384:0@lo:400: 00000100:00100000:1.0:1789601371.462997:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601371.463005:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918240640:0@lo:41: 00000100:00100000:1.0:1789601371.463030:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.463051:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240640 00000100:00100000:1.0:1789601371.463054:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240640 00000100:00100000:1.0:1789601371.463074:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601371.463079:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918240640:12345-0@lo:41: 00000004:00000024:1.0:1789601371.463103:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789601371.463135:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918240640:12345-0@lo:41: Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.463140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601371.463170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918240640:0@lo:41: 00000100:00100000:3.0:1789601371.468824:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601371.471888:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789601371.471899:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789601371.474646:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789601371.474679:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789601371.475167:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789601371.475198:0:8432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789601371.475204:0:8432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789601371.510211:0:8432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789601371.510257:0:8432:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789601371.510261:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789601371.510263:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601371.510264:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601371.510265:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601371.510266:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601371.510267:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601371.510269:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601371.510270:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601371.510271:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601371.510273:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601371.510278:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601371.510282:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789601371.510284:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601371.510285:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601371.510286:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601371.510287:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601371.510287:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601371.510288:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601371.510289:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601371.510290:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601371.510291:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601371.510291:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601371.510292:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601371.510323:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789601371.510342:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918240768:0@lo:253: 00000100:00100000:0.0:1789601371.510416:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.513036:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94ccf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.513940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240768 00000100:00100000:3.0:1789601371.513951:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240768 00000100:00100000:3.0:1789601371.514048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789601371.514060:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:8432:x1876532918240768:12345-0@lo:253: 20000000:01000000:3.0:1789601371.514117:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789601371.514121:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789601371.514127:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789601371.514130:0:6515:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789601371.514421:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601371.514594:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789601371.514609:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789601371.514646:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789601371.514655:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789601371.514678:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789601371.514694:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789601371.514777:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789601371.514791:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601371.514793:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601371.514806:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789601371.514811:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601371.514824:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789601371.514829:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601371.514841:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789601371.514847:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789601371.514859:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789601371.514874:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789601371.514963:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789601371.514974:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601371.514976:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601371.514990:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789601371.514996:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601371.515007:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789601371.515011:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601371.515022:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789601371.515028:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789601371.515040:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789601371.515054:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789601371.518961:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789601371.519424:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601371.519427:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601371.519451:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789601371.519460:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789601371.519492:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789601371.519498:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601371.519512:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789601371.519519:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789601371.519532:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789601371.519548:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789601371.519589:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789601371.519592:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789601371.519596:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789601371.519650:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601371.519653:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789601371.520478:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789601371.520527:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789601371.520542:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789601371.520907:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789601371.520930:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789601371.520946:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789601371.520958:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789601371.520960:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789601371.522251:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789601371.522290:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789601371.522306:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789601371.522860:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789601371.522897:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789601371.522923:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789601371.522937:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789601371.522939:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789601371.525272:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789601371.525332:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789601371.525350:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789601371.526038:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789601371.526063:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789601371.526077:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789601371.526091:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789601371.526094:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789601371.526767:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789601371.526917:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789601371.526938:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789601371.526952:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1789601371.526968:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789601371.526991:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527010:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f116d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527018:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527025:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527031:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f124d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527038:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527056:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527101:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527115:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.527131:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918240896:0@lo:104: 00000100:00100000:3.0:1789601371.527199:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601371.527299:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.527308:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.527317:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241024:0@lo:104: 00000100:00100000:3.0:1789601371.527339:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601371.528368:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.528389:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 18 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.528400:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241152:0@lo:104: 00000100:00100000:3.0:1789601371.528430:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.528536:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918240896 00000100:00100000:2.0:1789601371.528545:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918240896 00000100:00100000:2.0:1789601371.528615:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241024 00000100:00100000:2.0:1789601371.528619:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241024 00000100:00100000:2.0:1789601371.528634:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601371.528655:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918240896:12345-0@lo:104: 00010000:00010000:2.0:1789601371.528675:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528731:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601371.528738:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918240896:12345-0@lo:104: Request processed in 86us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.528745:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601371.528767:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601371.528773:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918241024:12345-0@lo:104: 00010000:00010000:2.0:1789601371.528780:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528814:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601371.528819:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918241024:12345-0@lo:104: Request processed in 47us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.528824:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789601371.528841:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601371.528846:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528863:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601371.528868:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528877:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.528883:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601371.528889:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601371.528919:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528925:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601371.528945:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528951:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f1285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f128c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528965:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601371.528967:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528972:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601371.528974:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.528990:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.528995:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601371.528999:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601371.529012:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529017:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601371.529022:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529028:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f124d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1254 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.529038:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.529039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.529045:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601371.529063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918241408:0@lo:103: 00000100:00100000:2.0:1789601371.529091:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.529115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601371.529123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918241280:0@lo:103: 00000100:00100000:2.0:1789601371.529142:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.529171:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241408 00000100:00100000:2.0:1789601371.529175:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241408 00010000:00010000:2.0:1789601371.529193:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601371.529218:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241280 00000100:00100000:2.0:1789601371.529222:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241280 00010000:00010000:2.0:1789601371.529702:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 20 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601371.529732:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601371.529739:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3648:x1876532918241408:12345-0@lo:103: 00010000:00010000:2.0:1789601371.529749:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601371.529754:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 20 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529764:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 20 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529782:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601371.529817:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3648:x1876532918241408:12345-0@lo:103: Request processed in 79us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.529823:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601371.529837:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601371.529844:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3648:x1876532918241280:12345-0@lo:103: 00010000:00010000:2.0:1789601371.529851:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601371.529856:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529865:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.529874:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601371.529905:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3648:x1876532918241280:12345-0@lo:103: Request processed in 62us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.529911:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601371.529949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918241280:0@lo:103: 00000100:00100000:2.0:1789601371.529959:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918241408:0@lo:103: 00010000:00010000:3.0:1789601371.530177:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.530194:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.530204:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241536:0@lo:104: 00000100:00100000:3.0:1789601371.530344:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601371.530462:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.530471:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 18 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.530480:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241664:0@lo:104: 00000100:00100000:3.0:1789601371.530500:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.530603:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0f00 going to sleep for 11 seconds 00010000:00010000:3.0:1789601371.530619:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1528c00/0x74872e3eca9f128c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1285 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.530631:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918240896:0@lo:104: 00010000:00010000:3.0:1789601371.530652:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679a00/0x74872e3eca9f1254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f124d expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.530661:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241024:0@lo:104: 00000100:00100000:1.0:1789601371.530816:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241152 00000100:00100000:1.0:1789601371.530823:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241152 00000100:00100000:1.0:1789601371.530852:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241536 00000100:00100000:1.0:1789601371.530854:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241536 00000100:00100000:1.0:1789601371.530863:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241664 00000100:00100000:1.0:1789601371.530865:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241664 00000100:00100000:1.0:1789601371.530876:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601371.530883:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6515:x1876532918241152:12345-0@lo:104: 00010000:00010000:1.0:1789601371.530893:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.530948:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601371.530954:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6515:x1876532918241152:12345-0@lo:104: Request processed in 72us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.530960:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601371.530974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601371.530980:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918241536:12345-0@lo:104: 00010000:00010000:1.0:1789601371.530987:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531015:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601371.531026:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918241536:12345-0@lo:104: Request processed in 47us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.531032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601371.531046:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601371.531051:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918241664:12345-0@lo:104: 00010000:00010000:1.0:1789601371.531058:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531087:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789601371.531092:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918241664:12345-0@lo:104: Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.531098:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789601371.531117:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601371.531123:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531129:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601371.531134:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531141:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601371.531149:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601371.531155:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601371.531180:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531196:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601371.531214:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531220:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1528800/0x74872e3eca9f1231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1238 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531232:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601371.531235:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531240:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e0a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601371.531243:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531250:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601371.531256:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601371.531261:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601371.531273:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531279:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601371.531283:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531289:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f11e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f11eb expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531305:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601371.531308:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531314:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601371.531317:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531323:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601371.531329:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601371.531334:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601371.531346:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531352:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601371.531364:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531383:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f116d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1174 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531396:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601371.531398:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601371.531400:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601371.531411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918241792:0@lo:103: 00000100:00100000:1.0:1789601371.531443:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.531469:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601371.531475:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918241920:0@lo:103: 00000100:00100000:1.0:1789601371.531493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.531517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918242048:0@lo:103: 00000100:00100000:1.0:1789601371.531538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.531589:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241792 00000100:00100000:1.0:1789601371.531594:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241792 00010000:00010000:1.0:1789601371.531611:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 17 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.531628:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918241920 00000100:00100000:1.0:1789601371.531631:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918241920 00010000:00010000:1.0:1789601371.531653:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.531673:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242048 00000100:00100000:1.0:1789601371.531676:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242048 00010000:00010000:1.0:1789601371.531686:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 19 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.531699:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601371.531705:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3645:x1876532918241792:12345-0@lo:103: 00010000:00010000:1.0:1789601371.531714:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601371.531719:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 19 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531729:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 19 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531754:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601371.531781:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3645:x1876532918241792:12345-0@lo:103: Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.531787:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601371.531801:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601371.531807:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3645:x1876532918241920:12345-0@lo:103: 00010000:00010000:1.0:1789601371.531814:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601371.531819:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531827:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531836:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601371.531855:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3645:x1876532918241920:12345-0@lo:103: Request processed in 49us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.531860:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601371.531871:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601371.531876:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3647:x1876532918242048:12345-0@lo:103: 00010000:00010000:1.0:1789601371.531883:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601371.531887:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531896:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531909:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531923:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531938:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531946:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531953:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531960:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531966:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601371.531971:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531977:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531985:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.531996:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601371.532021:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3647:x1876532918242048:12345-0@lo:103: Request processed in 145us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.532027:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601371.532083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918241920:0@lo:103: 00000100:00100000:1.0:1789601371.532098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918241792:0@lo:103: 00000100:00100000:1.0:1789601371.532122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918242048:0@lo:103: 00010000:00010000:1.0:1789601371.532136:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601371.532145:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601371.532396:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679c00/0x74872e3eca9f1238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1231 expref: 16 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.532409:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241152:0@lo:104: 00010000:00010000:3.0:1789601371.532419:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1528200/0x74872e3eca9f11eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f11e4 expref: 15 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.532435:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241536:0@lo:104: 00010000:00010000:3.0:1789601371.532446:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f1174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f116d expref: 14 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601371.532454:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918241664:0@lo:104: 00010000:00010000:3.0:1789601371.532477:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.532488:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.532495:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.532502:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601371.532514:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789601371.542655:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:8432:x1876532918240768:12345-0@lo:253: Request processed in 28587us (32228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.542680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789601371.542904:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918240768:0@lo:253: 10000000:01000000:0.0:1789601371.542922:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789601371.542926:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601371.542928:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601371.542929:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601371.542930:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789601371.542932:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601371.542933:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601371.542934:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601371.542936:0:8432:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789601371.542937:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601371.542938:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789601371.542961:0:8432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df4f70a3000 from lustre-OST0000 10000000:01000000:0.0:1789601371.542992:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789601371.542995:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789601371.543002:0:8432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f3720000 local copy 10000000:01000000:0.0:1789601371.543017:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789601371.543058:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.543069:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.543080:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.543098:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242176:0@lo:101: 00000100:00100000:0.0:1789601371.543137:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.543179:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601371.543241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242176 00000100:00100000:2.0:1789601371.543249:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242176 00000100:00100000:2.0:1789601371.543303:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601371.543314:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+13:8432:x1876532918242176:12345-0@lo:101: 00010000:00010000:2.0:1789601371.543327:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601371.543340:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f12b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f12af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.543366:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f12b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f12af expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.543388:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f12b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12af expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.543398:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383200, rc 0) 00000100:00100000:2.0:1789601371.543441:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242176:12345-0@lo:101: Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.543446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601371.543912:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242176:0@lo:101: 00010000:00010000:1.0:1789601371.543947:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.543961:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.544124:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242304:0@lo:501: 00000100:00100000:1.0:1789601371.544198:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.545859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242304 00000100:00100000:3.0:1789601371.545872:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242304 00000100:00100000:3.0:1789601371.545931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601371.545941:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242304:12345-0@lo:501: 00000100:00100000:3.0:1789601371.546065:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242304:12345-0@lo:501: Request processed in 125us (1866us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601371.546072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789601371.546383:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.546427:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242304:0@lo:501: 10000000:01000000:1.0:1789601371.546460:0:8432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789601371.546719:0:8432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789601371.546732:0:8432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.546756:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.546767:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.546798:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789601371.546857:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4f70a3000 10000000:01000000:1.0:1789601371.546863:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789601371.546869:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789601371.546872:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601371.546878:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789601371.546882:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601371.546894:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601371.546906:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.546917:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030600 already unused, calling callback (ffffffffc1529c20) 00010000:00010000:1.0:1789601371.546921:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.546939:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.546940:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.546974:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.546978:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.546996:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601371.547005:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789601371.547018:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242432:0@lo:101: 00010000:00010000:2.0:1789601371.547042:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.547051:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601371.547091:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.547093:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601371.547108:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f12af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f12b6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.547132:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.547138:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.547141:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601371.547143:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.547206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918242560:0@lo:103: 00000100:00100000:3.0:1789601371.547493:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.547608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242432 00000100:00100000:0.0:1789601371.547616:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242432 00000100:00100000:0.0:1789601371.547814:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789601371.547824:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242432:12345-0@lo:101: 00010000:00010000:0.0:1789601371.547836:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601371.547852:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f12bd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.547879:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.547891:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.547901:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030800, rc 0) 00000100:00100000:0.0:1789601371.548188:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918242432:12345-0@lo:101: Request processed in 365us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.548208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789601371.548339:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242432:0@lo:101: 00010000:00010000:2.0:1789601371.548359:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.548484:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601371.548773:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242688:0@lo:501: 00000100:00100000:2.0:1789601371.548815:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.548884:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601371.548915:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242688 00000100:00100000:0.0:1789601371.548922:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242688 00000100:00100000:0.0:1789601371.548999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789601371.549008:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918242688:12345-0@lo:501: 00000100:00100000:1.0:1789601371.549013:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242560 00000100:00100000:1.0:1789601371.549026:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242560 00000100:00100000:1.0:1789601371.549107:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601371.549120:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3648:x1876532918242560:12345-0@lo:103: 00010000:00010000:1.0:1789601371.549137:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601371.549172:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f12b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f12af expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.549195:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601371.549223:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918242688:12345-0@lo:501: Request processed in 214us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.549231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789601371.549276:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242688:0@lo:501: 00000100:00100000:2.0:1789601371.549302:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242816:0@lo:503: 00000100:00100000:2.0:1789601371.549335:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.549383:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601371.549464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242816 00000100:00100000:0.0:1789601371.549469:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242816 00000100:00100000:0.0:1789601371.549524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601371.549531:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918242816:12345-0@lo:503: 00000100:00100000:0.0:1789601371.549646:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918242816:12345-0@lo:503: Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.549653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789601371.549731:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242816:0@lo:503: 00000040:00080000:2.0:1789601371.549936:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789601371.550003:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242944:0@lo:502: 00000100:00100000:2.0:1789601371.550033:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.550243:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3648:x1876532918242560:12345-0@lo:103: Request processed in 1121us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.550256:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601371.550277:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.550313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918242944 00000100:00100000:3.0:1789601371.550318:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918242944 00000100:00100000:1.0:1789601371.550343:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918242560:0@lo:103: 00000100:00100000:3.0:1789601371.550353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789601371.550363:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242944:12345-0@lo:502: 00000100:00100000:3.0:1789601371.550546:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918242944:12345-0@lo:502: Request processed in 185us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.550553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601371.550770:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918242944:0@lo:502: 00000040:00080000:2.0:1789601371.557881:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789601371.557946:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789601371.557960:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789601371.557971:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789601371.557982:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789601371.557994:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789601371.558050:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243072:0@lo:502: 00000100:00100000:2.0:1789601371.558130:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.558178:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e569c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.558257:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243072 00000100:00100000:1.0:1789601371.558284:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243072 00000100:00100000:1.0:1789601371.558367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601371.558378:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918243072:12345-0@lo:502: 00000100:00100000:1.0:1789601371.558594:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918243072:12345-0@lo:502: Request processed in 217us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.558602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601371.559017:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243072:0@lo:502: 00000040:00080000:2.0:1789601371.559087:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789601371.559098:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789601371.561415:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789601371.561425:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789601371.561454:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601371.561457:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789601371.561463:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601371.561479:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df4d09c99c0) 00000020:00000080:2.0:1789601371.561504:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789601371.561510:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789601371.561619:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4f70a3000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789601371.561628:0:8455:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789601371.561646:0:8455:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74872e3eca9f12d2 00010000:00010000:3.0:1789601371.570895:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789601371.571999:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789601371.578987:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789601371.584523:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789601371.597678:0:8455:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789601371.598054:0:8455:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789601371.619146:0:8455:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789601371.623136:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789601371.623149:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601371.623164:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601371.623166:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789601371.623169:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601371.623173:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601371.623174:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601371.623291:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601371.623294:0:8455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789601371.623319:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601371.623323:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601371.623324:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789601371.623327:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789601371.623583:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789601371.623613:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789601371.623635:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.623648:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601371.623656:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f70a3000 from 1 10000000:01000000:0.0:1789601371.623659:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601371.623710:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.623742:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.623756:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.623782:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243200:0@lo:101: 00000100:00100000:0.0:1789601371.623853:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.623902:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.624552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243200 00000100:00100000:3.0:1789601371.624584:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243200 00000100:00100000:3.0:1789601371.624640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789601371.624651:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:8432:x1876532918243200:12345-0@lo:101: 00010000:00010000:3.0:1789601371.624674:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601371.624688:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f12d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.624716:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.624857:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.624867:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363000, rc 0) 00000100:00100000:3.0:1789601371.624915:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243200:12345-0@lo:101: Request processed in 265us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.625019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789601371.625829:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243200:0@lo:101: 00010000:00010000:0.0:1789601371.625851:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.625862:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.626351:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243328:0@lo:501: 00000100:00100000:0.0:1789601371.626398:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.626470:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601371.632725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243328 00000100:00100000:2.0:1789601371.632743:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243328 00000100:00100000:2.0:1789601371.632885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789601371.632898:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243328:12345-0@lo:501: 00000100:00100000:2.0:1789601371.633134:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243328:12345-0@lo:501: Request processed in 239us (6735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.633143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789601371.634345:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243328:0@lo:501: 00000100:00100000:1.0:1789601371.634410:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243456:0@lo:503: 00000100:00100000:1.0:1789601371.634483:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.634525:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.634991:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243456 00000100:00100000:3.0:1789601371.635000:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243456 00000100:00100000:3.0:1789601371.635052:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789601371.635061:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243456:12345-0@lo:503: 00000100:00100000:3.0:1789601371.635228:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243456:12345-0@lo:503: Request processed in 167us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.635236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789601371.635549:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243456:0@lo:503: 00000040:00080000:0.0:1789601371.636021:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601371.636103:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243584:0@lo:502: 00000100:00100000:0.0:1789601371.636762:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.636864:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.636905:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243584 00000100:00100000:3.0:1789601371.636912:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243584 00000100:00100000:3.0:1789601371.637047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789601371.637056:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243584:12345-0@lo:502: 00000100:00100000:3.0:1789601371.637172:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243584:12345-0@lo:502: Request processed in 116us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.637317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789601371.637398:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243584:0@lo:502: 00000040:00080000:0.0:1789601371.637659:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789601371.637706:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789601371.637734:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243712:0@lo:502: 00000100:00100000:0.0:1789601371.637772:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.638081:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.638142:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243712 00000100:00100000:1.0:1789601371.638148:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243712 00000100:00100000:1.0:1789601371.638195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601371.638205:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243712:12345-0@lo:502: 00000100:00100000:1.0:1789601371.638297:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243712:12345-0@lo:502: Request processed in 94us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.638304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789601371.638437:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243712:0@lo:502: 00000040:00080000:0.0:1789601371.638480:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789601371.638504:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789601371.639687:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601371.639698:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601371.639700:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789601371.639707:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4f70a3000 00000020:00000080:0.0:1789601371.639710:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601371.639723:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601371.639726:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601371.639727:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789601371.639730:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789601371.639883:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789601371.639909:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601371.639942:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.639966:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601371.640026:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789601371.640030:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4f70a3000 10000000:01000000:1.0:1789601371.640033:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4f70a3000 10000000:01000000:1.0:1789601371.640036:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601371.640042:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f70a3000 from 1 10000000:01000000:1.0:1789601371.640044:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601371.640079:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640088:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640097:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.640116:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243840:0@lo:101: 00000100:00100000:1.0:1789601371.640364:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.640407:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.640430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243840 00000100:00100000:1.0:1789601371.640437:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243840 00000100:00100000:1.0:1789601371.640470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601371.640478:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8432:x1876532918243840:12345-0@lo:101: 00010000:00010000:1.0:1789601371.640489:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601371.640501:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f12e7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640535:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640545:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640590:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1000, rc 0) 00000100:00100000:1.0:1789601371.640629:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918243840:12345-0@lo:101: Request processed in 151us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.640635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601371.640692:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243840:0@lo:101: 00010000:00010000:1.0:1789601371.640707:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601371.640716:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601371.640793:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243968:0@lo:501: 00000100:00100000:1.0:1789601371.640819:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601371.640837:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.640848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918243968 00000100:00100000:1.0:1789601371.640852:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918243968 00000100:00100000:1.0:1789601371.640867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789601371.640873:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918243968:12345-0@lo:501: 00000100:00100000:1.0:1789601371.641129:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918243968:12345-0@lo:501: Request processed in 255us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.641136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789601371.644396:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918243968:0@lo:501: 00000100:00100000:0.0:1789601371.644474:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244096:0@lo:503: 00000100:00100000:0.0:1789601371.644867:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.644911:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601371.645032:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244096 00000100:00100000:1.0:1789601371.645040:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244096 00000100:00100000:1.0:1789601371.645100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789601371.645111:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244096:12345-0@lo:503: 00000100:00100000:1.0:1789601371.645372:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244096:12345-0@lo:503: Request processed in 262us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.645381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601371.645547:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244096:0@lo:503: 00000040:00080000:0.0:1789601371.645849:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601371.646112:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244224:0@lo:502: 00000100:00100000:0.0:1789601371.646290:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.646377:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.646540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244224 00000100:00100000:3.0:1789601371.646548:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244224 00000100:00100000:0.0:1789601371.646824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789601371.646833:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244224:12345-0@lo:502: 00000100:00100000:0.0:1789601371.646966:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244224:12345-0@lo:502: Request processed in 134us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.646975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789601371.647110:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244224:0@lo:502: 00000040:00080000:2.0:1789601371.647322:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789601371.647347:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789601371.647358:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789601371.647371:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789601371.647381:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789601371.647394:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789601371.647406:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789601371.647418:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789601371.647427:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789601371.647438:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789601371.647451:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789601371.647461:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789601371.647472:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789601371.647483:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789601371.647495:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789601371.647506:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789601371.647517:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789601371.647530:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789601371.647542:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789601371.647584:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789601371.647601:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789601371.647613:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789601371.647624:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789601371.647637:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789601371.647679:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789601371.647696:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789601371.647707:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789601371.647718:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789601371.647730:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789601371.647740:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789601371.647751:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789601371.647772:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789601371.647784:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789601371.647796:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789601371.647808:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789601371.647820:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789601371.647830:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789601371.647865:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244352:0@lo:502: 00000100:00100000:2.0:1789601371.647913:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.647958:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601371.648168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244352 00000100:00100000:0.0:1789601371.648227:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244352 00000100:00100000:0.0:1789601371.648275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789601371.648283:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244352:12345-0@lo:502: 00000100:00100000:0.0:1789601371.648374:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244352:12345-0@lo:502: Request processed in 91us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.648381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601371.648612:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244352:0@lo:502: 00000040:00080000:2.0:1789601371.648661:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789601371.648680:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789601371.649336:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789601371.649361:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df3c2104d40) 00000020:00000080:2.0:1789601371.649388:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789601371.649462:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4f70a3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789601371.649465:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4f70a3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789601371.649468:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f70a3000 3 00010000:00080000:2.0:1789601371.649502:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c19cc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1789601371.652811:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789601371.653414:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789601371.653464:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601371.653479:0:8460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x74872e3eca9f12fc 00000100:00080000:2.0:1789601371.653998:0:8460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601371.654015:0:8460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df3c19cc800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601371.654062:0:8460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c5c00 x1876532918244480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601371.654084:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789601371.654626:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918244480:0@lo:38: 00000100:00100000:3.0:1789601371.654703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.654880:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244480 00000100:00100000:0.0:1789601371.654890:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244480 00000100:00100000:3.0:1789601371.655015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601371.655025:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918244480:12345-0@lo:38: 00010000:00080000:3.0:1789601371.655052:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1789601371.655085:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x74872e3eca9f1303 00000004:00100000:3.0:1789601371.655099:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789601371.655133:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8df501e66000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601371.655210:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876532918244480:12345-0@lo:38: Request processed in 185us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.655218:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789601371.655271:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df4d09c5c00 x1876532918244480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601371.655283:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601371.655292:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789601371.655300:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789601371.655305:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789601371.655307:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789601371.655313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918244480:0@lo:38: 00000020:01000004:3.0:1789601371.661456:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789601371.661475:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8df4f7354d40) 00000020:00000080:3.0:1789601371.661501:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789601371.661616:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4f70a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789601371.661620:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4f70a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789601371.661622:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f70a3000 3 00010000:00080000:3.0:1789601371.661652:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c19cb000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601371.663255:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789601371.663453:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789601371.663494:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601371.663506:0:8460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x74872e3eca9f1311 00000100:00080000:3.0:1789601371.663517:0:8460:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601371.663527:0:8460:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8df3c19cb000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601371.663597:0:8460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c1a39f80 x1876532918244608/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601371.663641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918244608:0@lo:38: 00000100:00100000:3.0:1789601371.663740:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.663810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244608 00000100:00100000:3.0:1789601371.663818:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244608 00000100:00100000:3.0:1789601371.663857:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601371.663865:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918244608:12345-0@lo:38: 00010000:00080000:3.0:1789601371.663891:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1789601371.663921:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x74872e3eca9f1318 00000004:00100000:3.0:1789601371.663935:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789601371.663978:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8df3c2393000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601371.664027:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876532918244608:12345-0@lo:38: Request processed in 162us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.664034:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789601371.664076:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df3c1a39f80 x1876532918244608/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601371.664086:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601371.664094:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789601371.664102:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789601371.664106:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789601371.664108:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789601371.664114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918244608:0@lo:38: 00000100:00080000:3.0:1789601371.664134:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789601371.674135:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789601371.674287:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789601371.674319:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601371.674344:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.674357:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789601371.674423:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789601371.674426:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601371.674427:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601371.674429:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601371.674430:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601371.674432:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601371.674433:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601371.674434:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601371.674436:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601371.674438:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601371.674439:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789601371.674443:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789601371.674445:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601371.674446:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601371.674447:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601371.674449:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601371.674450:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601371.674451:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601371.674452:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601371.674452:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601371.674453:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601371.674454:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601371.674455:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789601371.674486:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789601371.674506:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244736:0@lo:253: 00000100:00100000:3.0:1789601371.674602:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.674645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244736 00000100:00100000:3.0:1789601371.674653:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244736 00000100:00100000:3.0:1789601371.674709:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601371.674719:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244736:12345-0@lo:253: 20000000:01000000:3.0:1789601371.674744:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789601371.674758:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789601371.674872:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0180 going to sleep for 11 seconds 20000000:01000000:3.0:1789601371.686788:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789601371.686808:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789601371.687050:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789601371.687056:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789601371.687080:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687099:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687107:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f123f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687115:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687158:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687173:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.687206:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918244864:0@lo:104: 00000100:00100000:0.0:1789601371.687275:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601371.687327:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601371.687335:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 16 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.687343:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918244992:0@lo:104: 00000100:00100000:0.0:1789601371.687362:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d23696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601371.687529:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:8432:x1876532918244736:12345-0@lo:253: Request processed in 12809us (12925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.687540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789601371.687672:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789601371.687696:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.687725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244864 00000100:00100000:2.0:1789601371.687734:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244864 00000100:00100000:2.0:1789601371.687773:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918244992 00000100:00100000:2.0:1789601371.687777:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918244992 00000100:00100000:2.0:1789601371.687792:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601371.687801:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df501fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918244864:12345-0@lo:104: 00010000:00010000:2.0:1789601371.687814:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.687872:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601371.687878:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df501fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918244864:12345-0@lo:104: Request processed in 79us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.687886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601371.687987:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601371.687996:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918244992:12345-0@lo:104: 00010000:00010000:2.0:1789601371.688005:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688042:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601371.688048:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918244992:12345-0@lo:104: Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.688054:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601371.688094:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918244864:0@lo:104: 00000100:00100000:2.0:1789601371.688105:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918244992:0@lo:104: 00010000:00010000:2.0:1789601371.688125:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688166:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601371.688171:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688249:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601371.688253:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688262:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.688269:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601371.688275:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601371.688308:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688315:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601371.688334:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688342:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f123f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1246 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688355:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601371.688358:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688375:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601371.688378:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688385:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601371.688391:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601371.688396:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601371.688410:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688416:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601371.688422:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688429:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0030c00/0x74872e3eca9f1215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f121c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688444:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.688446:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.688447:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601371.688454:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601371.688474:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918245120:0@lo:103: 00000100:00100000:2.0:1789601371.688504:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.688535:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601371.688541:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918245248:0@lo:103: 00000100:00100000:2.0:1789601371.688597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.688631:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245120 00000100:00100000:2.0:1789601371.688636:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245120 00010000:00010000:2.0:1789601371.688654:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601371.688684:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245248 00000100:00100000:2.0:1789601371.688687:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245248 00010000:00010000:2.0:1789601371.688698:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601371.688715:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601371.688721:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3645:x1876532918245120:12345-0@lo:103: 00010000:00010000:2.0:1789601371.688731:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601371.688736:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688746:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688759:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1529c00/0x74872e3eca9f1246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f123f expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688771:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601371.688797:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3645:x1876532918245120:12345-0@lo:103: Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.688803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601371.688817:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601371.688823:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3645:x1876532918245248:12345-0@lo:103: 00010000:00010000:2.0:1789601371.688830:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601371.688839:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 15 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688848:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 15 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688857:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f121c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1215 expref: 15 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688870:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688879:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601371.688892:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014887876s 00010000:00010000:2.0:1789601371.688897:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688905:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688911:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.688917:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.689349:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8432:1876532918244736:0@lo:253: 10000000:01000000:0.0:1789601371.689362:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789601371.689364:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601371.689366:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601371.689367:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601371.689368:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601371.689369:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601371.689370:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601371.689372:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601371.689374:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601371.689375:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601371.689376:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601371.689378:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601371.689390:0:8432:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789601371.690495:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601371.690502:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.690512:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789601371.700943:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789601371.701113:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789601371.701362:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789601371.701516:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789601371.701774:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789601371.702001:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789601371.708589:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789601371.711272:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601371.711291:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601371.712515:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918245120:0@lo:103: 00010000:00010000:2.0:1789601371.716906:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.717244:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f131f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601371.717265:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601371.718096:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3645:x1876532918245248:12345-0@lo:103: Request processed in 29267us (29493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.718108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601371.722980:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918245248:0@lo:103: 00002000:00080000:3.0:1789601371.727117:0:8432:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789601371.727127:0:8432:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789601371.727166:0:8432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789601371.727211:0:8432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789601371.727234:0:8432:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789601371.727261:0:8432:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789601371.728217:0:8432:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789601371.728397:0:8432:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789601371.786130:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601371.974599:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601371.974625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918245376:0@lo:41: 00000100:00100000:1.0:1789601371.974711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.981321:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245376 00000100:00100000:3.0:1789601371.981335:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245376 00000100:00100000:3.0:1789601371.981395:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601371.981406:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918245376:12345-0@lo:41: 00000004:00000024:3.0:1789601371.981443:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1789601371.984337:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918245376:12345-0@lo:41: Request processed in 2926us (9618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.984350:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601371.984458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918245376:0@lo:41: 00000020:00000004:1.0:1789601372.767860:0:8516:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601372.768090:0:8516:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789601372.805804:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601373.836191:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601374.854523:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601375.879935:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601376.583552:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918245504:0@lo:41: 00000100:00100000:0.0:1789601376.583714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601376.584245:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245504 00000100:00100000:0.0:1789601376.584256:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245504 00000100:00100000:0.0:1789601376.584310:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601376.584320:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918245504:12345-0@lo:41: 00000004:00000024:0.0:1789601376.584351:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789601376.584404:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918245504:12345-0@lo:41: Request processed in 85us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601376.584411:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601376.584663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918245504:0@lo:41: 00010000:00010000:1.0:1789601376.905136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601377.095295:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918245632:0@lo:41: 00000100:00100000:0.0:1789601377.095373:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601377.095462:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245632 00000100:00100000:0.0:1789601377.095471:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245632 00000100:00100000:0.0:1789601377.095521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601377.095531:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918245632:12345-0@lo:41: 00000004:00000024:0.0:1789601377.095585:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789601377.095648:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918245632:12345-0@lo:41: Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601377.095656:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601377.095706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918245632:0@lo:41: 00000100:00100000:2.0:1789601377.097232:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918245760:0@lo:400: 00000100:00100000:2.0:1789601377.097296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097333:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918246272:0@lo:400: 00000100:00100000:2.0:1789601377.097379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097407:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601377.097414:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918246144:0@lo:400: 00000100:00100000:2.0:1789601377.097439:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097469:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246144 00000100:00100000:2.0:1789601377.097477:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246144 00000100:00100000:2.0:1789601377.097521:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601377.097530:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918246144:12345-0@lo:400: 00000100:00100000:2.0:1789601377.097599:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918246144:12345-0@lo:400: Request processed in 71us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.097605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601377.097641:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918246016:0@lo:400: 00000100:00100000:2.0:1789601377.097666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789601377.097699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918245888:0@lo:400: 00000100:00100000:2.0:1789601377.097720:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918246400:0@lo:400: 00000100:00100000:2.0:1789601377.097760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601377.097780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245760 00000100:00100000:2.0:1789601377.097784:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245760 00000100:00100000:2.0:1789601377.097810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789601377.097817:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3646:x1876532918245760:12345-0@lo:400: 00000100:00100000:2.0:1789601377.097846:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:3646:x1876532918245760:12345-0@lo:400: Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.097852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789601377.097878:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246272 00000100:00100000:2.0:1789601377.097881:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246272 00000100:00100000:2.0:1789601377.097910:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246016 00000100:00100000:2.0:1789601377.097913:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246016 00000100:00100000:2.0:1789601377.097923:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918245888 00000100:00100000:2.0:1789601377.097924:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918245888 00000100:00100000:2.0:1789601377.097931:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246400 00000100:00100000:2.0:1789601377.097933:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246400 00000100:00100000:2.0:1789601377.097945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601377.097949:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918246272:12345-0@lo:400: 00000100:00100000:2.0:1789601377.097978:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918246272:12345-0@lo:400: Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.097984:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601377.097996:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601377.098002:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918246016:12345-0@lo:400: 00000100:00100000:2.0:1789601377.098033:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918246016:12345-0@lo:400: Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.098045:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601377.098058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601377.098064:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918245888:12345-0@lo:400: 00000100:00100000:2.0:1789601377.098093:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918245888:12345-0@lo:400: Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.098098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601377.098109:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601377.098114:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918246400:12345-0@lo:400: 00000100:00100000:2.0:1789601377.098139:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918246400:12345-0@lo:400: Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.098144:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789601377.098172:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601377.098176:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789601377.098203:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c5180 x1876532918245888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601377.098217:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918245888:0@lo:400: 00010000:00080000:2.0:1789601377.098228:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c4a80 x1876532918246400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601377.098236:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918246400:0@lo:400: 00010000:00080000:2.0:1789601377.098245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c4380 x1876532918246016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601377.098252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918246016:0@lo:400: 00000100:00100000:2.0:1789601377.098284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918246144:0@lo:400: 00000100:00100000:2.0:1789601377.098293:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918245760:0@lo:400: 00010000:00080000:2.0:1789601377.098313:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c7100 x1876532918246272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601377.098321:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918246272:0@lo:400: 00010000:00010000:1.0:1789601377.925839:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601378.395951:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789601378.951603:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789601379.143525:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789601379.143533:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f8b56000 from 30 10000000:01000000:1.0:1789601379.143538:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601379.143700:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.143713:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.143726:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.143760:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246528:0@lo:101: 00000100:00100000:1.0:1789601379.149767:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.149855:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9b54f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.149897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246528 00000100:00100000:1.0:1789601379.149907:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246528 00000100:00100000:1.0:1789601379.149963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789601379.149973:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:6519:x1876532918246528:12345-0@lo:101: 00010000:00010000:1.0:1789601379.149993:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.150014:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1326 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.150046:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.150057:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.150068:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1c00, rc 0) 00000100:00100000:1.0:1789601379.150128:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918246528:12345-0@lo:101: Request processed in 157us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.150134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789601379.150190:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246528:0@lo:101: 00010000:00010000:1.0:1789601379.150206:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.150216:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.150297:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246656:0@lo:501: 00000100:00100000:1.0:1789601379.150328:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.150342:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9b54f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.150354:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246656 00000100:00100000:1.0:1789601379.150358:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246656 00000100:00100000:1.0:1789601379.150377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789601379.150382:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918246656:12345-0@lo:501: 00000100:00100000:1.0:1789601379.150479:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918246656:12345-0@lo:501: Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.150486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789601379.150510:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246656:0@lo:501: 00000100:00100000:1.0:1789601379.150531:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246784:0@lo:503: 00000100:00100000:1.0:1789601379.150582:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.150592:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.150602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246784 00000100:00100000:1.0:1789601379.150605:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246784 00000100:00100000:1.0:1789601379.150641:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789601379.150648:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918246784:12345-0@lo:503: 00000100:00100000:1.0:1789601379.150718:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918246784:12345-0@lo:503: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.150724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789601379.150763:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918246784:0@lo:503: 00000100:00100000:1.0:1789601379.150961:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8843:1876532918246912:0@lo:502: 00000100:00100000:1.0:1789601379.150988:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.151009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918246912 00000100:00100000:1.0:1789601379.151012:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918246912 00000100:00100000:1.0:1789601379.151028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789601379.151032:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8843:x1876532918246912:12345-0@lo:502: 00000100:00100000:1.0:1789601379.151090:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8843:x1876532918246912:12345-0@lo:502: Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.151096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789601379.151118:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.151128:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8843:1876532918246912:0@lo:502: 00000100:00100000:1.0:1789601379.151159:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8843:1876532918247040:0@lo:502: 00000100:00100000:1.0:1789601379.151183:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.151196:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247040 00000100:00100000:1.0:1789601379.151199:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247040 00000100:00100000:1.0:1789601379.151213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789601379.151218:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8843:x1876532918247040:12345-0@lo:502: 00000100:00100000:1.0:1789601379.151262:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:8843:x1876532918247040:12345-0@lo:502: Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.151267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789601379.151288:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.151297:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8843:1876532918247040:0@lo:502: 00000040:00080000:1.0:1789601379.151311:0:8843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789601379.151354:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789601379.151368:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601379.151375:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151385:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601379.151398:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789601379.151401:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4f8b56000 from 5 10000000:01000000:1.0:1789601379.151403:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601379.151422:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151429:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151438:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.151448:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247168:0@lo:101: 00000100:00100000:1.0:1789601379.151467:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.151477:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.151486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247168 00000100:00100000:1.0:1789601379.151489:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247168 00000100:00100000:1.0:1789601379.151504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789601379.151509:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918247168:12345-0@lo:101: 00010000:00010000:1.0:1789601379.151515:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.151533:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1334 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151550:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151576:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151592:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee800, rc 0) 00000100:00100000:1.0:1789601379.151631:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918247168:12345-0@lo:101: Request processed in 122us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.151637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789601379.151662:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247168:0@lo:101: 00010000:00010000:1.0:1789601379.151671:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151679:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.151711:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247296:0@lo:256: 00000100:00100000:1.0:1789601379.151735:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.151744:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.151753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247296 00000100:00100000:1.0:1789601379.151755:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247296 00000100:00100000:1.0:1789601379.151770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601379.151774:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918247296:12345-0@lo:256: 20000000:01000000:1.0:1789601379.151785:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789601379.151801:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789601379.151804:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789601379.151861:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918247296:12345-0@lo:256: Request processed in 85us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.151867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601379.151889:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247296:0@lo:256: 10000000:01000000:1.0:1789601379.151922:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601379.151930:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151937:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601379.151944:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789601379.151945:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789601379.151947:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789601379.151959:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151965:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.151972:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.151981:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247424:0@lo:101: 00000100:00100000:1.0:1789601379.151999:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.152008:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.152017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247424 00000100:00100000:1.0:1789601379.152019:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247424 00000100:00100000:1.0:1789601379.152033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601379.152038:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918247424:12345-0@lo:101: 00010000:00010000:1.0:1789601379.152043:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.152050:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1342 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.152062:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.152075:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.152081:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee400, rc 0) 00000100:00100000:1.0:1789601379.152102:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918247424:12345-0@lo:101: Request processed in 64us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.152107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601379.152129:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247424:0@lo:101: 00010000:00010000:1.0:1789601379.152137:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.152144:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.152174:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247552:0@lo:501: 00000100:00100000:1.0:1789601379.152191:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.152200:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.152209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247552 00000100:00100000:1.0:1789601379.152211:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247552 00000100:00100000:1.0:1789601379.152225:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601379.152230:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918247552:12345-0@lo:501: 00000100:00100000:1.0:1789601379.152298:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918247552:12345-0@lo:501: Request processed in 67us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.152303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601379.152338:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247552:0@lo:501: 00000100:00100000:1.0:1789601379.152357:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247680:0@lo:503: 00000100:00100000:1.0:1789601379.152385:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.152395:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.152403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247680 00000100:00100000:1.0:1789601379.152406:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247680 00000100:00100000:1.0:1789601379.152420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789601379.152425:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918247680:12345-0@lo:503: 00000100:00100000:1.0:1789601379.152478:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918247680:12345-0@lo:503: Request processed in 53us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.152484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789601379.152511:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918247680:0@lo:503: 00000100:00100000:1.0:1789601379.165274:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8844:1876532918247808:0@lo:502: 00000100:00100000:1.0:1789601379.166047:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.166092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247808 00000100:00100000:1.0:1789601379.166102:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247808 00000100:00100000:1.0:1789601379.166158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789601379.166168:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:8844:x1876532918247808:12345-0@lo:502: 00000100:00100000:1.0:1789601379.166303:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:8844:x1876532918247808:12345-0@lo:502: Request processed in 136us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.166310:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789601379.166375:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.166401:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8844:1876532918247808:0@lo:502: 00000020:01000000:1.0:1789601379.166432:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601379.166448:0:8844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789601379.166456:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.166459:0:8844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789601379.166463:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789601379.166472:0:8844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:1.0:1789601379.166494:0:8844:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789601379.166496:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601379.166511:0:8844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8df4f763b380) 00000020:00000080:1.0:1789601379.166532:0:8844:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789601379.166537:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789601379.166784:0:8844:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789601379.166791:0:8844:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789601379.166820:0:8844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f1357 00010000:00080000:1.0:1789601379.166852:0:8844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f7391000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789601379.167089:0:8844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789601379.186406:0:8844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789601379.186433:0:8844:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789601379.186976:0:8844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601379.187201:0:8844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601379.188121:0:8844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789601379.188229:0:8844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789601379.189054:0:8847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601379.189059:0:8847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789601379.190141:0:8844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789601379.190154:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789601379.190193:0:8844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789601379.190216:0:8844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f135e 00000100:00080000:1.0:1789601379.190227:0:8844:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601379.190239:0:8844:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df4f7391000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601379.190281:0:8844:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4cd0bad80 x1876532918247936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601379.190343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918247936:0@lo:8: 00000100:00100000:3.0:1789601379.190431:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.190703:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918247936 00000100:00100000:2.0:1789601379.190712:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918247936 00000100:00100000:2.0:1789601379.190751:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601379.190759:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918247936:12345-0@lo:8: 00010000:00080000:2.0:1789601379.190786:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1789601379.190824:0:8439:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f1365 00002000:00100000:2.0:1789601379.190852:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8df3c23db000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789601379.190856:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789601379.190860:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789601379.190914:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789601379.191101:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789601379.191126:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c23dc000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789601379.192948:0:8844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789601379.193093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918248064:0@lo:400: 00000100:00100000:1.0:1789601379.193150:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193181:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918248576:0@lo:400: 00000100:00100000:1.0:1789601379.193219:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601379.193246:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918248448:0@lo:400: 00000100:00100000:1.0:1789601379.193268:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918248320:0@lo:400: 00000100:00100000:1.0:1789601379.193317:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193333:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601379.193338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918248192:0@lo:400: 00000100:00100000:1.0:1789601379.193356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193370:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918248704:0@lo:400: 00000100:00100000:1.0:1789601379.193403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.193424:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248064 00000100:00100000:1.0:1789601379.193431:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248064 00000100:00100000:1.0:1789601379.193466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248576 00000100:00100000:1.0:1789601379.193469:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248576 00000100:00100000:1.0:1789601379.193488:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248320 00000100:00100000:1.0:1789601379.193491:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248320 00000100:00100000:1.0:1789601379.193501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248704 00000100:00100000:1.0:1789601379.193503:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248704 00000100:00100000:1.0:1789601379.193517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601379.193524:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918248064:12345-0@lo:400: 00000100:00100000:1.0:1789601379.193591:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918248064:12345-0@lo:400: Request processed in 65us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.193598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601379.193626:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601379.193633:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918248576:12345-0@lo:400: 00000100:00100000:1.0:1789601379.193657:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918248576:12345-0@lo:400: Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.193671:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601379.193682:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601379.193696:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918248320:12345-0@lo:400: 00000100:00100000:1.0:1789601379.193729:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918248320:12345-0@lo:400: Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.193734:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601379.193746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601379.193751:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918248704:12345-0@lo:400: 00000100:00100000:1.0:1789601379.193775:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918248704:12345-0@lo:400: Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.193780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601379.193798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248448 00000100:00100000:1.0:1789601379.193802:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248448 00000100:00100000:1.0:1789601379.194149:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248192 00000100:00100000:1.0:1789601379.194154:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248192 00000100:00100000:1.0:1789601379.194166:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601379.194172:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918248448:12345-0@lo:400: 00000100:00100000:1.0:1789601379.194207:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918248448:12345-0@lo:400: Request processed in 35us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.194213:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601379.194225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601379.194230:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918248192:12345-0@lo:400: 00000100:00100000:1.0:1789601379.194253:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918248192:12345-0@lo:400: Request processed in 22us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.194257:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789601379.194278:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601379.194288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601379.194324:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918248192:0@lo:400: 00010000:00080000:1.0:1789601379.194338:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b8000 x1876532918248704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.194352:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918248704:0@lo:400: 00010000:00080000:1.0:1789601379.194362:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bb800 x1876532918248320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.194369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918248320:0@lo:400: 00000100:00100000:1.0:1789601379.194399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918248448:0@lo:400: 00010000:00080000:1.0:1789601379.194407:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b8e00 x1876532918248064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.194414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918248064:0@lo:400: 00010000:00080000:1.0:1789601379.194422:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b9c00 x1876532918248576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.194430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918248576:0@lo:400: 00000020:01000000:1.0:1789601379.194503:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601379.194509:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.194511:0:8844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789601379.194514:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601379.194517:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.194519:0:8844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789601379.194522:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789601379.194523:0:8844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789601379.194735:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8844:1876532918248832:0@lo:502: 00000100:00100000:1.0:1789601379.194782:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.196403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248832 00000100:00100000:1.0:1789601379.196416:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248832 00000100:00100000:1.0:1789601379.196538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601379.196627:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:8844:x1876532918248832:12345-0@lo:502: 00000100:00100000:1.0:1789601379.196790:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:8844:x1876532918248832:12345-0@lo:502: Request processed in 243us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.196797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601379.197035:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.197062:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8844:1876532918248832:0@lo:502: 00000020:01000000:1.0:1789601379.197096:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601379.197103:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.197105:0:8844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789601379.197110:0:8844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789601379.197171:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789601379.197188:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789601379.197198:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197210:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601379.197219:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789601379.197222:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4d017d800 from 30 10000000:01000000:1.0:1789601379.197225:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601379.197256:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197264:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197285:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.197303:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918248960:0@lo:101: 00000100:00100000:1.0:1789601379.197339:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.197358:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.197371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918248960 00000100:00100000:1.0:1789601379.197375:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918248960 00000100:00100000:1.0:1789601379.197399:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601379.197405:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918248960:12345-0@lo:101: 00010000:00010000:1.0:1789601379.197412:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.197424:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f136c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197680:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f136c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197700:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f136c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197710:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee000, rc 0) 00000100:00100000:1.0:1789601379.197738:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918248960:12345-0@lo:101: Request processed in 334us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.197744:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601379.197775:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918248960:0@lo:101: 00010000:00010000:1.0:1789601379.197788:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.197818:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.197870:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249088:0@lo:501: 00000100:00100000:1.0:1789601379.197896:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.197917:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.197928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249088 00000100:00100000:1.0:1789601379.197931:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249088 00000100:00100000:1.0:1789601379.197953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601379.197959:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918249088:12345-0@lo:501: 00000100:00100000:1.0:1789601379.198053:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918249088:12345-0@lo:501: Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.198060:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601379.198091:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249088:0@lo:501: 00000100:00100000:1.0:1789601379.198116:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249216:0@lo:503: 00000100:00100000:1.0:1789601379.198154:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.198166:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.198179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249216 00000100:00100000:1.0:1789601379.198182:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249216 00000100:00100000:1.0:1789601379.198204:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789601379.198209:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918249216:12345-0@lo:503: 00000100:00100000:1.0:1789601379.198286:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918249216:12345-0@lo:503: Request processed in 76us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.198293:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789601379.198332:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249216:0@lo:503: 00000100:00100000:1.0:1789601379.198880:0:8849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8849:1876532918249344:0@lo:502: 00000100:00100000:1.0:1789601379.198915:0:8849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.198936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249344 00000100:00100000:1.0:1789601379.198940:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249344 00000100:00100000:1.0:1789601379.198962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601379.198968:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:8849:x1876532918249344:12345-0@lo:502: 00000100:00100000:1.0:1789601379.199042:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:8849:x1876532918249344:12345-0@lo:502: Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.199048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601379.199080:0:8849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.199092:0:8849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8849:1876532918249344:0@lo:502: 00000100:00100000:1.0:1789601379.199128:0:8849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8849:1876532918249472:0@lo:502: 00000100:00100000:1.0:1789601379.199159:0:8849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.199177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249472 00000100:00100000:1.0:1789601379.199180:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249472 00000100:00100000:1.0:1789601379.199200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601379.199205:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:8849:x1876532918249472:12345-0@lo:502: 00000100:00100000:1.0:1789601379.199259:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:8849:x1876532918249472:12345-0@lo:502: Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.199265:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601379.199292:0:8849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.199303:0:8849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8849:1876532918249472:0@lo:502: 00000040:00080000:1.0:1789601379.199321:0:8849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789601379.199362:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789601379.199378:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601379.199385:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199401:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601379.199410:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789601379.199412:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4d017d800 from 5 10000000:01000000:1.0:1789601379.199415:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601379.199435:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199692:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199703:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.199715:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249600:0@lo:101: 00000100:00100000:1.0:1789601379.199741:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.199759:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.199770:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249600 00000100:00100000:1.0:1789601379.199773:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249600 00000100:00100000:1.0:1789601379.199795:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601379.199800:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918249600:12345-0@lo:101: 00010000:00010000:1.0:1789601379.199820:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.199831:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f137a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199853:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f137a expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199876:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f137a expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199885:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef400, rc 0) 00000100:00100000:1.0:1789601379.199912:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918249600:12345-0@lo:101: Request processed in 112us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.199919:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601379.199949:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249600:0@lo:101: 00010000:00010000:1.0:1789601379.199959:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.199968:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.200009:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249728:0@lo:256: 00000100:00100000:1.0:1789601379.200039:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.200051:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.200061:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249728 00000100:00100000:1.0:1789601379.200065:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249728 00000100:00100000:1.0:1789601379.200084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601379.200089:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918249728:12345-0@lo:256: 20000000:01000000:1.0:1789601379.200101:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789601379.200117:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789601379.200120:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789601379.200192:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918249728:12345-0@lo:256: Request processed in 102us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.200198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601379.200234:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249728:0@lo:256: 10000000:01000000:1.0:1789601379.200270:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601379.200275:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200283:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601379.200290:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789601379.200292:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789601379.200294:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601379.200307:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200314:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200321:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.200332:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249856:0@lo:101: 00000100:00100000:1.0:1789601379.200653:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.200671:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.200682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249856 00000100:00100000:1.0:1789601379.200685:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249856 00000100:00100000:1.0:1789601379.200865:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601379.200873:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918249856:12345-0@lo:101: 00010000:00010000:1.0:1789601379.200881:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601379.200890:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1388 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200915:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200923:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.200931:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eea00, rc 0) 00000100:00100000:1.0:1789601379.200970:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918249856:12345-0@lo:101: Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.200975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601379.201015:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249856:0@lo:101: 00010000:00010000:1.0:1789601379.201026:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.201033:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601379.201089:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249984:0@lo:501: 00000100:00100000:1.0:1789601379.201111:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.201124:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.201135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918249984 00000100:00100000:1.0:1789601379.201138:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918249984 00000100:00100000:1.0:1789601379.201156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601379.201163:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918249984:12345-0@lo:501: 00000100:00100000:1.0:1789601379.201255:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918249984:12345-0@lo:501: Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.201260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601379.201295:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918249984:0@lo:501: 00000100:00100000:1.0:1789601379.201319:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918250112:0@lo:503: 00000100:00100000:2.0:1789601379.201537:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918247936:12345-0@lo:8: Request processed in 10775us (11103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601379.201638:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789601379.201935:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bad80 x1876532918247936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601379.201946:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601379.201955:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789601379.201965:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789601379.201970:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789601379.201974:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7391000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789601379.201995:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789601379.202002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918247936:0@lo:8: 00000100:00100000:3.0:1789601379.202048:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918250240:0@lo:700: 00000100:00100000:3.0:1789601379.202078:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601379.202101:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.202181:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.202235:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250240 00000100:00100000:2.0:1789601379.202240:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250240 00000100:00100000:2.0:1789601379.202277:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601379.202283:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8848:x1876532918250240:12345-0@lo:700: 00000100:00100000:2.0:1789601379.202311:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1876532918250368:0@lo:700: 00000100:00100000:2.0:1789601379.202336:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.202449:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e4bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601379.202632:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250368 00000100:00100000:0.0:1789601379.202647:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250368 00000100:00100000:0.0:1789601379.202733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601379.202746:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1876532918250368:12345-0@lo:700: 00000004:00080000:0.0:1789601379.202944:0:8847:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789601379.203027:0:8847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 247324469690ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789601379.203039:0:8847:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789601379.204636:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00080000:1.0:1789601379.204675:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789601379.205374:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789601379.206985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250112 00000100:00100000:3.0:1789601379.207001:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250112 00000100:00100000:3.0:1789601379.209740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789601379.209754:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918250112:12345-0@lo:503: 00000100:00100000:3.0:1789601379.209936:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918250112:12345-0@lo:503: Request processed in 185us (7754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.209944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601379.210321:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918250112:0@lo:503: 00000100:00100000:0.0:1789601379.211350:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8851:1876532918250496:0@lo:502: 00000100:00100000:0.0:1789601379.211444:0:8851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601379.211500:0:8851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601379.212065:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250496 00000100:00100000:2.0:1789601379.212074:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250496 00000100:00100000:2.0:1789601379.212619:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789601379.212635:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:8851:x1876532918250496:12345-0@lo:502: 40000000:02000000:3.0:1789601379.213185:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789601379.213631:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:8851:x1876532918250496:12345-0@lo:502: Request processed in 996us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601379.213645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601379.219723:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8851:1876532918250496:0@lo:502: 00000020:01000000:1.0:1789601379.219784:0:8851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601379.219793:0:8851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789601379.219804:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.219807:0:8851:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789601379.219814:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789601379.219819:0:8851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:1.0:1789601379.219844:0:8851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789601379.219847:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601379.219865:0:8851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df4f76399c0) 00000020:00000080:1.0:1789601379.219891:0:8851:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789601379.219898:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789601379.219993:0:8851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789601379.220000:0:8851:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789601379.220008:0:8851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f139d 00010000:00080000:1.0:1789601379.220049:0:8851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f8da5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789601379.220387:0:8851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1789601379.223399:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1876532918250368:12345-0@lo:700: Request processed in 20648us (21052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.223413:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601379.223876:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23fc380 x1876532918250368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601379.223895:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1876532918250368:0@lo:700: 40000000:02000000:0.0:1789601379.223912:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1789601379.232439:0:8851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789601379.232474:0:8851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789601379.233038:0:8851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601379.233663:0:8851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601379.234011:0:8851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789601379.234435:0:8851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789601379.235066:0:8854:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601379.235073:0:8854:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789601379.236224:0:8851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601379.236235:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789601379.236273:0:8851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789601379.236297:0:8851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f13a4 00000100:00080000:2.0:1789601379.236309:0:8851:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601379.236322:0:8851:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df4f8da5000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601379.236364:0:8851:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c23fd500 x1876532918250624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601379.236424:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918250624:0@lo:8: 00000100:00100000:3.0:1789601379.236502:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.236543:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250624 00000100:00100000:1.0:1789601379.236551:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250624 00000100:00100000:1.0:1789601379.236603:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789601379.236618:0:8851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789601379.236620:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918250624:12345-0@lo:8: 00010000:00080000:1.0:1789601379.236647:0:8441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:01000000:2.0:1789601379.236671:0:8851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601379.236674:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601379.236675:0:8441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f13ab 00000020:00000080:2.0:1789601379.236676:0:8851:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789601379.236679:0:8851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601379.236683:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00002000:00100000:1.0:1789601379.236686:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df4ccc2b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1789601379.236688:0:8851:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00002000:00080000:1.0:1789601379.236690:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:00000080:2.0:1789601379.236692:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00002000:00100000:1.0:1789601379.236693:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:2.0:1789601379.236694:0:8851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789601379.236716:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8851:1876532918250752:0@lo:502: 00000100:00100000:2.0:1789601379.236762:0:8851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.236786:0:8851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e4b180 going to sleep for 11 seconds 00002000:00080000:1.0:1789601379.236856:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789601379.236881:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601379.239294:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250752 00000100:00100000:0.0:1789601379.239306:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250752 00000100:00100000:0.0:1789601379.239697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789601379.239708:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:8851:x1876532918250752:12345-0@lo:502: 00000100:00100000:0.0:1789601379.240052:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:8851:x1876532918250752:12345-0@lo:502: Request processed in 347us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601379.240057:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789601379.240160:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:8851:1876532918250752:0@lo:502: 00000020:01000000:2.0:1789601379.240193:0:8851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601379.240200:0:8851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601379.240203:0:8851:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789601379.240210:0:8851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789601379.240315:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918250624:12345-0@lo:8: Request processed in 3693us (3810us total) trans 0 rc 0/0 00010000:00080000:3.0:1789601379.240737:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23fd500 x1876532918250624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.240859:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601379.241161:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601379.241171:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789601379.241180:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789601379.241186:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789601379.241189:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789601379.241199:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789601379.241207:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918250624:0@lo:8: 00000004:00080000:3.0:1789601379.241835:0:8854:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:2.0:1789601379.242205:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789601379.242234:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789601379.242245:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601379.242258:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601379.242268:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789601379.242270:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f3720000 from 1 10000000:01000000:2.0:1789601379.242273:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789601379.242310:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601379.242317:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601379.242326:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601379.242368:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918250880:0@lo:101: 00000100:00100000:2.0:1789601379.242425:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.242645:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e4b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601379.242664:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918250880 00000100:00100000:3.0:1789601379.242801:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918250880 00000100:00100000:3.0:1789601379.242875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789601379.242886:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918250880:12345-0@lo:101: 00010000:00010000:3.0:1789601379.243237:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601379.243261:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f13b2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601379.243293:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601379.243305:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601379.243315:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363e00, rc 0) 00000100:00100000:3.0:1789601379.243865:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918250880:12345-0@lo:101: Request processed in 979us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.243899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000001:00100000:0.0:1789601379.244076:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789601379.244086:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789601379.244585:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918250240:12345-0@lo:700: Request processed in 42298us (42501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.244602:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789601379.244693:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c1a3b800 x1876532918250240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.244709:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918250240:0@lo:700: 00000004:00080000:3.0:1789601379.244933:0:8854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247366373870ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789601379.244944:0:8854:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789601379.248140:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918250880:0@lo:101: 00010000:00010000:2.0:1789601379.248177:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601379.248192:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601379.248291:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918251008:0@lo:501: 00000100:00100000:2.0:1789601379.248366:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.248414:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601379.248451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251008 00000100:00100000:2.0:1789601379.248458:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251008 00000100:00100000:3.0:1789601379.248497:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601379.248511:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601379.248524:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918251136:0@lo:13: 00000100:00100000:2.0:1789601379.248524:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918251008:12345-0@lo:501: 00000100:00100000:3.0:1789601379.248659:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789601379.248710:0:8855:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789601379.248718:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918251008:12345-0@lo:501: Request processed in 193us (347us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601379.248728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601379.248757:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918251264:0@lo:7: 00000100:00100000:2.0:1789601379.248803:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251136 00000100:00100000:3.0:1789601379.248804:0:8855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601379.248830:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601379.249205:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251136 00000100:00100000:2.0:1789601379.249256:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601379.249263:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918251136:12345-0@lo:13: 00002000:00000024:2.0:1789601379.249285:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789601379.249502:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918251136:12345-0@lo:13: Request processed in 238us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601379.249517:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601379.249542:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251264 00000100:00100000:2.0:1789601379.249631:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251264 00000100:00100000:2.0:1789601379.249662:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601379.249668:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8855:x1876532918251264:12345-0@lo:7: 00000100:00080000:1.0:1789601379.250804:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601379.251305:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c1a38000 x1876532918251136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601379.251334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918251136:0@lo:13: 00000100:00100000:1.0:1789601379.251712:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918251008:0@lo:501: 10000000:01000000:1.0:1789601379.251771:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601379.251784:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601379.251796:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601379.252866:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789601379.253998:0:8848:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789601379.254026:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601379.254033:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251520:0@lo:7: 00000100:00100000:3.0:1789601379.254059:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918251392:0@lo:13: 00000100:00100000:1.0:1789601379.254126:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601379.254165:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.254179:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.254208:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789601379.254215:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789601379.255691:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251520 00000100:00100000:1.0:1789601379.255702:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251520 00000100:00100000:0.0:1789601379.255835:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601379.255847:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918251520:12345-0@lo:7: 00002000:00080000:3.0:1789601379.259308:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789601379.259320:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789601379.259438:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8855:x1876532918251264:12345-0@lo:7: Request processed in 9764us (10630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.259468:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789601379.260625:0:8855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c1a3a300 x1876532918251264/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.260645:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918251264:0@lo:7: 00000004:00080000:1.0:1789601379.260663:0:8855:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789601379.260710:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918251648:0@lo:5: 00000100:00100000:1.0:1789601379.260776:0:8855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.260815:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601379.260905:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251648 00000100:00100000:0.0:1789601379.260913:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251648 00000100:00100000:0.0:1789601379.260981:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601379.260991:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8855:x1876532918251648:12345-0@lo:5: 00002000:00080000:0.0:1789601379.261020:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789601379.261023:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789601379.261082:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251392 00000100:00100000:2.0:1789601379.261088:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251392 00000100:00100000:2.0:1789601379.261123:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601379.261130:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1876532918251392:12345-0@lo:13: 00002000:00000024:2.0:1789601379.261143:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789601379.261201:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1876532918251392:12345-0@lo:13: Request processed in 72us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601379.261208:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601379.261283:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f8945c00 x1876532918251392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601379.261300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918251392:0@lo:13: 00002000:00080000:3.0:1789601379.275755:0:8857:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789601379.275766:0:8857:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789601379.275949:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918251520:12345-0@lo:7: Request processed in 20099us (21818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.275962:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601379.283013:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f8946300 x1876532918251520/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.283032:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251520:0@lo:7: 00000004:00080000:1.0:1789601379.283048:0:8848:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789601379.283096:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251776:0@lo:5: 00000100:00100000:1.0:1789601379.283157:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.283199:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601379.283219:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251776 00000100:00100000:1.0:1789601379.283225:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251776 00000100:00100000:1.0:1789601379.283279:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601379.283288:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918251776:12345-0@lo:5: 00002000:00080000:1.0:1789601379.283315:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789601379.283357:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918251776:12345-0@lo:5: Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.283376:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789601379.283403:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b9c00 x1876532918251776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.283412:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251776:0@lo:5: 00000004:00080000:1.0:1789601379.283420:0:8848:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789601379.284602:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251904:0@lo:5: 00000100:00100000:1.0:1789601379.284672:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.284701:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601379.285169:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918251904 00000100:00100000:3.0:1789601379.285185:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918251904 00000100:00100000:3.0:1789601379.285243:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601379.285259:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8848:x1876532918251904:12345-0@lo:5: 00002000:00080000:3.0:1789601379.285300:0:8857:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789601379.286984:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8855:x1876532918251648:12345-0@lo:5: Request processed in 25990us (26202us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789601379.286996:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789601379.289275:0:8855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f8946680 x1876532918251648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601379.289299:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918251648:0@lo:5: 00000004:00080000:2.0:1789601379.289317:0:8855:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789601379.289338:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8848:x1876532918251904:12345-0@lo:5: Request processed in 4079us (4663us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789601379.289349:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601379.289361:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918252032:0@lo:700: 00000100:00100000:2.0:1789601379.289400:0:8855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601379.289427:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601379.289465:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252032 00000100:00100000:3.0:1789601379.289473:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252032 00000100:00100000:3.0:1789601379.289527:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601379.289538:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8855:x1876532918252032:12345-0@lo:700: 00010000:00080000:1.0:1789601379.289673:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b9c00 x1876532918251904/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.289685:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8848:1876532918251904:0@lo:5: 00000004:00080000:1.0:1789601379.289695:0:8848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789601379.289720:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8848:1876532918252160:0@lo:900: 00000100:00100000:1.0:1789601379.289746:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.289768:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601379.289990:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252160 00000100:00100000:3.0:1789601379.289996:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252160 00000100:00100000:3.0:1789601379.290180:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601379.290189:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8848:x1876532918252160:12345-0@lo:900: 00000100:00100000:3.0:1789601379.290243:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8848:x1876532918252160:12345-0@lo:900: Request processed in 55us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.290250:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789601379.290427:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bb800 x1876532918252160/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.290449:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8848:1876532918252160:0@lo:900: 00000001:00080000:0.0:1789601379.301369:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1789601379.301384:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:1.0:1789601379.302317:0:8855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23ff100 x1876532918252032/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.302331:0:8855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789601379.302356:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918252032:0@lo:700: 00000100:00100000:3.0:1789601379.303753:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8855:x1876532918252032:12345-0@lo:700: Request processed in 14210us (14346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601379.303766:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:1.0:1789601379.310086:0:8855:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789601379.323273:0:8855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918252288:0@lo:5: 00000100:00100000:1.0:1789601379.323351:0:8855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.323437:0:8855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601379.329161:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252288 00000100:00100000:0.0:1789601379.329178:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252288 00000100:00100000:2.0:1789601379.329857:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601379.329870:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8855:x1876532918252288:12345-0@lo:5: 00002000:00080000:2.0:1789601379.339010:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789601379.339030:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789601379.340511:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8855:x1876532918252288:12345-0@lo:5: Request processed in 10638us (17153us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789601379.340529:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789601379.342065:0:8855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bb800 x1876532918252288/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601379.342086:0:8855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8855:1876532918252288:0@lo:5: 00000004:00080000:3.0:1789601379.342102:0:8855:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:2.0:1789601379.351314:0:8867:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601379.351899:0:8867:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601379.976922:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789601380.231519:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1789601381.000718:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601381.702256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918252416:0@lo:41: 00000100:00100000:3.0:1789601381.702414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601381.707532:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252416 00000100:00100000:1.0:1789601381.707549:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252416 00000100:00100000:1.0:1789601381.707736:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601381.707749:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918252416:12345-0@lo:41: 00000004:00000024:1.0:1789601381.707790:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789601381.707884:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918252416:12345-0@lo:41: Request processed in 137us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601381.707892:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601381.708089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918252416:0@lo:41: 00010000:00010000:0.0:1789601382.022903:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601382.219223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918252544:0@lo:41: 00000100:00100000:1.0:1789601382.219331:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601382.219446:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252544 00000100:00100000:2.0:1789601382.219456:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252544 00000100:00100000:2.0:1789601382.219520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601382.219531:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918252544:12345-0@lo:41: 00000004:00000024:2.0:1789601382.219644:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789601382.222794:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918252544:12345-0@lo:41: Request processed in 3251us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601382.222811:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601382.225478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918252544:0@lo:41: 00000020:00000004:1.0:1789601382.342302:0:8968:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601382.342742:0:8968:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601383.046733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789601383.286525:0:9016:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601383.286540:0:9016:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789601384.070597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601384.262020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601384.262056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918252672:0@lo:13: 00000100:00100000:0.0:1789601384.262155:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601384.262256:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252672 00000100:00100000:0.0:1789601384.262265:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252672 00000100:00100000:0.0:1789601384.262325:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601384.262336:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918252672:12345-0@lo:13: 00002000:00000024:0.0:1789601384.262371:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601384.262436:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918252672:12345-0@lo:13: Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601384.262445:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789601384.262468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601384.262522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f8ab3100 x1876532918252672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601384.262535:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789601384.262768:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918252800:0@lo:400: 00000100:00100000:2.0:1789601384.262809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601384.262833:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918253312:0@lo:400: 00000100:00100000:2.0:1789601384.262858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601384.262881:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789601384.262888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918252928:0@lo:400: 00000100:00100000:2.0:1789601384.262913:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601384.262931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918253440:0@lo:400: 00000100:00100000:2.0:1789601384.262951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601384.263016:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253312 00000100:00100000:2.0:1789601384.263021:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253312 00000100:00100000:2.0:1789601384.263053:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601384.263069:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918253312:12345-0@lo:400: 00000100:00100000:2.0:1789601384.263112:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918253312:12345-0@lo:400: Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601384.263119:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601384.263143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252928 00000100:00100000:2.0:1789601384.263147:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252928 00000100:00100000:2.0:1789601384.263171:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253440 00000100:00100000:2.0:1789601384.263174:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253440 00000100:00100000:2.0:1789601384.263197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601384.263203:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918252928:12345-0@lo:400: 00000100:00100000:2.0:1789601384.263232:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918252928:12345-0@lo:400: Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601384.263239:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601384.263250:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601384.263256:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918253440:12345-0@lo:400: 00000100:00100000:2.0:1789601384.263279:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918253440:12345-0@lo:400: Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601384.263285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789601384.263323:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23fe680 x1876532918252928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601384.263336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918252928:0@lo:400: 00010000:00080000:2.0:1789601384.263347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23ff800 x1876532918253440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601384.263356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918253440:0@lo:400: 00000100:00100000:2.0:1789601384.263365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918253312:0@lo:400: 00000100:00100000:0.0:1789601384.263923:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918252672:0@lo:13: 00000100:00100000:0.0:1789601384.264166:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918253056:0@lo:400: 00000100:00100000:0.0:1789601384.264299:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601384.264332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918253568:0@lo:400: 00000100:00100000:0.0:1789601384.264365:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601384.264394:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789601384.264603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918252800 00000100:00100000:3.0:1789601384.264615:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918252800 00000100:00100000:3.0:1789601384.264679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789601384.264689:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3647:x1876532918252800:12345-0@lo:400: 00000100:00100000:3.0:1789601384.264753:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3647:x1876532918252800:12345-0@lo:400: Request processed in 65us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601384.264760:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789601384.264832:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601384.264842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918253824:0@lo:13: 00000100:00100000:3.0:1789601384.264873:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601384.264910:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253824 00000100:00100000:3.0:1789601384.264915:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253824 00000100:00100000:3.0:1789601384.264950:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601384.264958:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918253824:12345-0@lo:13: 00002000:00000024:3.0:1789601384.264974:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601384.265374:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918253184:0@lo:400: 00000100:00100000:3.0:1789601384.265511:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918253824:12345-0@lo:13: Request processed in 553us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601384.265519:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789601384.265607:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c1a39500 x1876532918253824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601384.265619:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789601384.265648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918253824:0@lo:13: 00000100:00100000:3.0:1789601384.265682:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918252800:0@lo:400: 00000100:00100000:0.0:1789601384.265873:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601384.265904:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918253696:0@lo:400: 00000100:00100000:0.0:1789601384.265934:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601384.265966:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253696 00000100:00100000:0.0:1789601384.265971:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253696 00000100:00100000:0.0:1789601384.266916:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601384.266933:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918253696:12345-0@lo:400: 00000100:00100000:2.0:1789601384.268139:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253056 00000100:00100000:2.0:1789601384.268153:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253056 00000100:00100000:2.0:1789601384.268212:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601384.268235:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918253056:12345-0@lo:400: 00000100:00080000:3.0:1789601384.272544:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601384.272605:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601384.273903:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253568 00000100:00100000:3.0:1789601384.273923:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253568 00000100:00100000:3.0:1789601384.274004:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253184 00000100:00100000:3.0:1789601384.274008:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253184 00000100:00100000:3.0:1789601384.274032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601384.274044:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918253568:12345-0@lo:400: 00000100:00100000:2.0:1789601384.274277:0:6523:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601384.274290:0:6523:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789601384.274437:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789601384.274447:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918253184:12345-0@lo:400: 00000100:00100000:2.0:1789601384.274521:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918253184:12345-0@lo:400: Request processed in 76us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601384.274529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789601384.275773:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601384.287172:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918253696:12345-0@lo:400: Request processed in 20229us (21219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601384.287191:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789601384.288500:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23fd180 x1876532918253184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601384.288522:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918253184:0@lo:400: 00010000:00080000:0.0:1789601384.288720:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23ff100 x1876532918253696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601384.288758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918253696:0@lo:400: 00000100:00100000:3.0:1789601384.296002:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918253568:12345-0@lo:400: Request processed in 21949us (31624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601384.296020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601384.296092:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918253056:12345-0@lo:400: Request processed in 27871us (31793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601384.296102:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789601384.296490:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918253056:0@lo:400: 00010000:00080000:0.0:1789601384.296511:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c23fce00 x1876532918253568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601384.296523:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918253568:0@lo:400: 00010000:00010000:0.0:1789601385.095522:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601386.118693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601386.826855:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601386.826880:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918253952:0@lo:41: 00000100:00100000:0.0:1789601386.826966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601386.827115:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918253952 00000100:00100000:2.0:1789601386.827126:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918253952 00000100:00100000:2.0:1789601386.827177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601386.827186:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918253952:12345-0@lo:41: 00000004:00000024:2.0:1789601386.827220:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789601386.827277:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918253952:12345-0@lo:41: Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601386.827285:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601386.827360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918253952:0@lo:41: 00010000:00010000:1.0:1789601387.143191:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601387.335610:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601387.335648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918254080:0@lo:41: 00000100:00100000:2.0:1789601387.335736:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601387.335802:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254080 00000100:00100000:3.0:1789601387.335813:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254080 00000100:00100000:3.0:1789601387.335885:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601387.335896:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918254080:12345-0@lo:41: 00000004:00000024:3.0:1789601387.335936:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789601387.336010:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918254080:12345-0@lo:41: Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601387.336016:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601387.336183:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918254080:0@lo:41: 00010000:00010000:0.0:1789601388.173031:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601389.190006:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601389.386909:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918254208:0@lo:13: 00000100:00100000:0.0:1789601389.386983:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601389.387064:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254208 00000100:00100000:0.0:1789601389.387074:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254208 00000100:00100000:0.0:1789601389.387145:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601389.387156:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918254208:12345-0@lo:13: 00002000:00000024:0.0:1789601389.387187:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601389.387242:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918254208:12345-0@lo:13: Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601389.387249:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789601389.387273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601389.387306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2265880 x1876532918254208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601389.387340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918254208:0@lo:13: 00000100:00100000:0.0:1789601389.388009:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601389.388023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918254336:0@lo:13: 00000100:00100000:0.0:1789601389.388215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601389.388248:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254336 00000100:00100000:0.0:1789601389.388253:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254336 00000100:00100000:0.0:1789601389.388289:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601389.388297:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918254336:12345-0@lo:13: 00002000:00000024:0.0:1789601389.388312:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601389.388348:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918254336:12345-0@lo:13: Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601389.388356:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789601389.388375:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601389.388394:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2265880 x1876532918254336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601389.388408:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918254336:0@lo:13: 00000100:00100000:1.0:1789601389.394440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918254848:0@lo:400: 00000100:00100000:1.0:1789601389.394511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.394588:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789601389.394595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918254464:0@lo:400: 00000100:00100000:1.0:1789601389.394625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.394651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918254976:0@lo:400: 00000100:00100000:1.0:1789601389.394711:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.394741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918254592:0@lo:400: 00000100:00100000:1.0:1789601389.394763:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.394779:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918255104:0@lo:400: 00000100:00100000:1.0:1789601389.394797:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601389.395058:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254848 00000100:00100000:2.0:1789601389.395067:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254848 00000100:00100000:2.0:1789601389.395116:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254592 00000100:00100000:2.0:1789601389.395135:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254592 00000100:00100000:2.0:1789601389.395153:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255104 00000100:00100000:2.0:1789601389.395156:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255104 00000100:00100000:2.0:1789601389.395186:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601389.395196:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918254848:12345-0@lo:400: 00000100:00100000:2.0:1789601389.395263:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918254848:12345-0@lo:400: Request processed in 68us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601389.395271:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601389.395290:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601389.395296:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918254592:12345-0@lo:400: 00000100:00100000:2.0:1789601389.395325:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918254592:12345-0@lo:400: Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601389.395330:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601389.395342:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601389.395348:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918255104:12345-0@lo:400: 00000100:00100000:2.0:1789601389.395375:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918255104:12345-0@lo:400: Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601389.395381:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789601389.395612:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2809880 x1876532918255104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601389.395629:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918255104:0@lo:400: 00010000:00080000:1.0:1789601389.395653:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2808700 x1876532918254592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601389.395661:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918254592:0@lo:400: 00000100:00100000:1.0:1789601389.395732:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789601389.395740:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918254720:0@lo:400: 00000100:00100000:1.0:1789601389.395768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.395790:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918255232:0@lo:400: 00000100:00100000:1.0:1789601389.395810:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.395915:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255232 00000100:00100000:1.0:1789601389.395920:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255232 00000100:00100000:1.0:1789601389.395951:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601389.395958:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918255232:12345-0@lo:400: 00000100:00100000:1.0:1789601389.395996:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918255232:12345-0@lo:400: Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601389.396002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601389.396022:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254464 00000100:00100000:1.0:1789601389.396026:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254464 00000100:00100000:1.0:1789601389.396234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789601389.396242:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3647:x1876532918254464:12345-0@lo:400: 00000100:00100000:1.0:1789601389.396273:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3647:x1876532918254464:12345-0@lo:400: Request processed in 33us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601389.396279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789601389.396305:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254976 00000100:00100000:1.0:1789601389.396309:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254976 00000100:00100000:1.0:1789601389.396330:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918254720 00000100:00100000:1.0:1789601389.396332:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918254720 00000100:00100000:1.0:1789601389.396344:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601389.396349:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918254976:12345-0@lo:400: 00000100:00100000:1.0:1789601389.396381:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918254976:12345-0@lo:400: Request processed in 31us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601389.396387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601389.396398:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601389.396404:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918254720:12345-0@lo:400: 00000100:00100000:1.0:1789601389.396431:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918254720:12345-0@lo:400: Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601389.396436:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601389.396465:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918254464:0@lo:400: 00000100:00100000:1.0:1789601389.396476:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918254976:0@lo:400: 00010000:00080000:1.0:1789601389.396486:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2809f80 x1876532918254848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601389.396495:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918254848:0@lo:400: 00000100:00100000:1.0:1789601389.396548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918254720:0@lo:400: 00010000:00080000:1.0:1789601389.396592:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c280b800 x1876532918255232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601389.396601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918255232:0@lo:400: 00000100:00080000:0.0:1789601389.397898:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601389.397905:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789601390.216588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601391.239054:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601391.943662:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601391.943696:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918255360:0@lo:41: 00000100:00100000:0.0:1789601391.943788:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601391.943869:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255360 00000100:00100000:0.0:1789601391.943879:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255360 00000100:00100000:0.0:1789601391.943934:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789601391.943944:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918255360:12345-0@lo:41: 00000004:00000024:0.0:1789601391.943996:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789601391.945322:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918255360:12345-0@lo:41: Request processed in 1367us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601391.945336:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601391.948218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918255360:0@lo:41: 00010000:00010000:1.0:1789601392.268441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601392.454759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918255488:0@lo:41: 00000100:00100000:1.0:1789601392.455266:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601392.455493:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255488 00000100:00100000:0.0:1789601392.455503:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255488 00000100:00100000:0.0:1789601392.455625:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601392.455637:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918255488:12345-0@lo:41: 00000004:00000024:0.0:1789601392.455683:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789601392.455751:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918255488:12345-0@lo:41: Request processed in 116us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601392.455758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601392.455811:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918255488:0@lo:41: 00010000:00010000:1.0:1789601393.286002:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789601394.190215:0:9517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789601394.190220:0:9517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789601394.190221:0:9517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789601394.190356:0:9517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df501e60000 00000020:01000004:3.0:1789601394.190373:0:9517:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789601394.190387:0:9517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789601394.190400:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df4f7353380) 00000020:00000080:3.0:1789601394.190416:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789601394.251029:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789601394.251102:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789601394.309417:0:9517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00010000:00010000:0.0:1789601394.309824:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789601394.310424:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789601394.310445:0:9517:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789601394.310460:0:9517:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74872e3eca9f13c7 00000020:01000004:2.0:1789601394.310470:0:9517:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789601394.310507:0:9517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789601394.310511:0:9517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789601394.310699:0:9517:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789601394.310739:0:9517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789601394.310745:0:9517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789601394.351961:0:9517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789601394.352102:0:9517:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789601394.352107:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789601394.352109:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601394.352111:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601394.352112:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601394.352114:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601394.352115:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601394.352117:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601394.352119:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601394.352120:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601394.352122:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601394.352123:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789601394.352128:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789601394.352131:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789601394.352132:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601394.352134:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601394.352135:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601394.352136:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601394.352137:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601394.352138:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601394.352139:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601394.352140:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601394.352142:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601394.352143:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789601394.352179:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789601394.352281:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918255616:0@lo:253: 00000100:00100000:2.0:1789601394.352376:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601394.352513:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601394.353099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255616 00000100:00100000:3.0:1789601394.353110:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255616 00000100:00100000:3.0:1789601394.353215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789601394.353227:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:9517:x1876532918255616:12345-0@lo:253: 20000000:01000000:3.0:1789601394.353267:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789601394.353271:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789601394.353277:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789601394.353282:0:6515:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789601394.354329:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601394.354522:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789601394.354542:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789601394.354732:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789601394.354741:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789601394.354756:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789601394.354771:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789601394.354884:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789601394.354903:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601394.354906:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601394.354924:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789601394.354930:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601394.354944:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789601394.354949:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601394.354962:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789601394.354969:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789601394.354982:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789601394.354995:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789601394.355175:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789601394.355186:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601394.355188:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601394.355271:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789601394.355278:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789601394.355290:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789601394.355294:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601394.355307:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789601394.355312:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789601394.355323:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789601394.355335:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789601394.355948:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789601394.355962:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789601394.355964:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789601394.355979:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789601394.355983:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789601394.355994:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789601394.355999:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789601394.356011:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789601394.356095:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789601394.356112:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789601394.356127:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789601394.356143:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789601394.356147:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789601394.356151:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789601394.356278:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601394.356282:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789601394.362869:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789601394.362943:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789601394.362962:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789601394.367399:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789601394.367450:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789601394.367468:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1789601394.367482:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789601394.367486:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789601394.368168:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789601394.368196:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789601394.368281:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789601394.368976:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789601394.369003:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789601394.369092:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789601394.369117:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789601394.369120:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789601394.369937:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789601394.369973:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789601394.369990:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789601394.370454:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789601394.370477:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789601394.370493:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1789601394.370851:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789601394.370854:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789601394.371931:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789601394.372126:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789601394.372147:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789601394.373068:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789601394.373100:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789601394.373115:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789601394.373130:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789601394.373133:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789601394.373994:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789601394.374286:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789601394.374308:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789601394.374323:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1789601394.374371:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789601394.374395:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374415:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374423:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374431:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374438:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374444:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f136c expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374451:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374458:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374466:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374529:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.374547:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.374600:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fe680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918255744:0@lo:104: 00000100:00100000:2.0:1789601394.377510:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601394.377899:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.377919:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.377937:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918255872:0@lo:104: 00000100:00100000:2.0:1789601394.377980:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601394.390286:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.390309:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.390339:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256000:0@lo:104: 00000100:00100000:2.0:1789601394.390413:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601394.394508:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255744 00000100:00100000:3.0:1789601394.394539:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255744 00000100:00100000:3.0:1789601394.394647:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918255872 00000100:00100000:3.0:1789601394.394651:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918255872 00000100:00100000:1.0:1789601394.394878:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601394.394893:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918255744:12345-0@lo:104: 00010000:00010000:1.0:1789601394.394916:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395021:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601394.395028:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918255744:12345-0@lo:104: Request processed in 140us (17539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.395035:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601394.395057:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601394.395064:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918255872:12345-0@lo:104: 00010000:00010000:1.0:1789601394.395093:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395127:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601394.395132:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918255872:12345-0@lo:104: Request processed in 70us (17152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.395139:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789601394.395157:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601394.395164:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395172:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.395177:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395187:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.395196:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.395203:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.395244:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395252:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.395272:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395279:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f13b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395301:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601394.395305:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395311:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.395314:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395320:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.395345:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.395351:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.395365:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395371:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.395377:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395383:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f1388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f138f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.395393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601394.395395:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601394.395397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601394.395403:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.395487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918256128:0@lo:103: 00000100:00100000:1.0:1789601394.395548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.395639:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601394.395645:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918256256:0@lo:103: 00010000:00010000:2.0:1789601394.397414:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.397434:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 21 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.397451:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256384:0@lo:104: 00000100:00100000:2.0:1789601394.397526:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601394.397551:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.397599:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.397608:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256512:0@lo:104: 00000100:00100000:2.0:1789601394.397631:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601394.397648:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.397655:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.397857:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256640:0@lo:104: 00000100:00100000:2.0:1789601394.397888:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601394.397907:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.397916:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.397925:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256768:0@lo:104: 00000100:00100000:2.0:1789601394.397943:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601394.397968:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fe680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918255744:0@lo:104: 00000100:00100000:2.0:1789601394.397977:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918255872:0@lo:104: 00000100:00100000:3.0:1789601394.398227:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789601394.398248:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601394.398261:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256000 00000100:00100000:3.0:1789601394.398269:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256000 00000100:00100000:3.0:1789601394.398315:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256384 00000100:00100000:3.0:1789601394.398319:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256384 00000100:00100000:3.0:1789601394.398347:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256512 00000100:00100000:3.0:1789601394.398351:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256512 00000100:00100000:3.0:1789601394.398361:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256640 00000100:00100000:3.0:1789601394.398364:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256640 00000100:00100000:3.0:1789601394.398373:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256768 00000100:00100000:3.0:1789601394.398375:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256768 00000100:00100000:3.0:1789601394.398389:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601394.398398:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+7:6515:x1876532918256000:12345-0@lo:104: 00010000:00010000:3.0:1789601394.398414:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601394.398474:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601394.398490:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+7:6515:x1876532918256000:12345-0@lo:104: Request processed in 93us (8077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.398496:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601394.398537:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601394.398544:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6515:x1876532918256384:12345-0@lo:104: 00010000:00010000:3.0:1789601394.398553:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601394.398610:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789601394.398615:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:6515:x1876532918256384:12345-0@lo:104: Request processed in 72us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.398621:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601394.398633:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601394.398639:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6515:x1876532918256512:12345-0@lo:104: 00010000:00010000:3.0:1789601394.398646:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601394.398690:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789601394.398696:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:6515:x1876532918256512:12345-0@lo:104: Request processed in 57us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.398703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601394.398716:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789601394.398722:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2241050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918256640:12345-0@lo:104: 00010000:00010000:3.0:1789601394.398729:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601394.398755:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789601394.398765:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2241050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6515:x1876532918256640:12345-0@lo:104: Request processed in 44us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.398772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789601394.398806:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601394.398812:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918256768:12345-0@lo:104: 00010000:00010000:3.0:1789601394.398819:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601394.398844:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789601394.398849:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6515:x1876532918256768:12345-0@lo:104: Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.398856:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601394.399131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601394.399170:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789601394.399178:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399186:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efa00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.399191:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399201:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.399496:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256000:0@lo:104: 00000100:00100000:2.0:1789601394.399524:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256384:0@lo:104: 00000100:00100000:2.0:1789601394.399534:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256512:0@lo:104: 00000100:00100000:2.0:1789601394.399581:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256640:0@lo:104: 00000100:00100000:2.0:1789601394.399590:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876532918256768:0@lo:104: 00010000:00010000:2.0:1789601394.399624:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.399792:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.399798:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.399835:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399842:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.399866:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399873:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f136c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1373 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399897:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789601394.399901:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399907:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.399910:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399918:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.399924:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.399931:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.399944:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399950:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.399956:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399962:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1349 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399971:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601394.399975:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.399991:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.399994:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400001:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.400007:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.400012:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.400026:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400031:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.400039:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400045:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e1e00/0x74872e3eca9f1326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f132d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400056:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601394.400059:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400066:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.400069:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400087:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.400094:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.400100:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.400114:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400120:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.400125:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400132:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e1200/0x74872e3eca9f12e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12ee expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400142:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601394.400145:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400151:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e0a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601394.400154:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400161:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601394.400167:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601394.400179:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601394.400195:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400202:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601394.400206:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400213:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e0a00/0x74872e3eca9f12bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12c4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.400229:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601394.400231:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601394.400233:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.400250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918257280:0@lo:103: 00000100:00100000:1.0:1789601394.400300:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.402287:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601394.402311:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918257152:0@lo:103: 00000100:00100000:1.0:1789601394.402415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.402484:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256128 00000100:00100000:1.0:1789601394.402494:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256128 00010000:00010000:1.0:1789601394.402763:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 22 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.402789:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256256 00000100:00100000:1.0:1789601394.402793:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256256 00010000:00010000:1.0:1789601394.402840:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 23 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.402866:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257280 00000100:00100000:1.0:1789601394.402870:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257280 00010000:00010000:1.0:1789601394.402883:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 24 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.402894:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257152 00000100:00100000:1.0:1789601394.402896:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257152 00010000:00010000:1.0:1789601394.402907:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 25 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.402922:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601394.402931:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3645:x1876532918256128:12345-0@lo:103: 00010000:00010000:1.0:1789601394.402947:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601394.402954:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 25 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.402967:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 25 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.402988:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363e00/0x74872e3eca9f13b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f13b2 expref: 25 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403004:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.403044:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918256128:12345-0@lo:103: Request processed in 114us (7496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.403052:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601394.403071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601394.403078:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3645:x1876532918256256:12345-0@lo:103: 00010000:00010000:1.0:1789601394.403096:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601394.403102:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 23 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403111:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 23 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403121:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f138f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1388 expref: 23 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403130:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.403154:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3645:x1876532918256256:12345-0@lo:103: Request processed in 76us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.403160:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601394.403175:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601394.403181:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3646:x1876532918257280:12345-0@lo:103: 00010000:00010000:1.0:1789601394.403188:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601394.403193:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403201:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403211:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5021e1000/0x74872e3eca9f12ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f12e7 expref: 21 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403222:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.403258:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3646:x1876532918257280:12345-0@lo:103: Request processed in 77us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.403273:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601394.403286:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601394.403292:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3646:x1876532918257152:12345-0@lo:103: 00010000:00010000:1.0:1789601394.403301:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601394.403306:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403315:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403791:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5021e1c00/0x74872e3eca9f132d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1326 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.403803:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.403830:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3646:x1876532918257152:12345-0@lo:103: Request processed in 539us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.403837:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789601394.403885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.403902:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918256896:0@lo:103: 00000100:00100000:1.0:1789601394.403930:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.403998:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918257408:0@lo:103: 00000100:00100000:1.0:1789601394.404018:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601394.404097:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.407435:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601394.407460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918257024:0@lo:103: 00000100:00100000:1.0:1789601394.407726:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601394.410392:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918256896 00000100:00100000:2.0:1789601394.410412:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918256896 00010000:00010000:2.0:1789601394.410477:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 18 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.410568:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257408 00000100:00100000:2.0:1789601394.410572:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257408 00010000:00010000:2.0:1789601394.410586:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.410603:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601394.410612:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3647:x1876532918256896:12345-0@lo:103: 00010000:00010000:2.0:1789601394.410628:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601394.410635:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410651:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410684:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f1373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f136c expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410702:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601394.410811:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3647:x1876532918256896:12345-0@lo:103: Request processed in 200us (6880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.410839:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601394.410861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601394.410866:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3647:x1876532918257408:12345-0@lo:103: 00010000:00010000:2.0:1789601394.410874:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601394.410879:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410888:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410898:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f12c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f12bd expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.410909:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601394.410964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257024 00000100:00100000:0.0:1789601394.410969:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257024 00010000:00010000:0.0:1789601394.410992:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.411008:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601394.411015:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3647:x1876532918257024:12345-0@lo:103: 00010000:00010000:0.0:1789601394.411024:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601394.411029:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411048:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411060:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1342 expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411072:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411081:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411099:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411106:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.411110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918256896:0@lo:103: 00010000:00010000:0.0:1789601394.411114:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411126:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411133:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601394.411138:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411147:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601394.411176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918257152:0@lo:103: 00010000:00010000:0.0:1789601394.411176:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.411190:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.411203:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918257280:0@lo:103: 00000100:00100000:0.0:1789601394.411232:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3647:x1876532918257024:12345-0@lo:103: Request processed in 217us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.411240:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601394.411265:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918257024:0@lo:103: 00000100:00100000:0.0:1789601394.411304:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918256256:0@lo:103: 00000100:00100000:0.0:1789601394.411315:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918256128:0@lo:103: 00000100:00100000:2.0:1789601394.411534:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3647:x1876532918257408:12345-0@lo:103: Request processed in 667us (7513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.411543:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789601394.411595:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.411605:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.411612:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f13ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601394.411626:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789601394.411684:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918257408:0@lo:103: 00000100:00100000:2.0:1789601394.417904:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:9517:x1876532918255616:12345-0@lo:253: Request processed in 64668us (65516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.417942:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789601394.418060:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918255616:0@lo:253: 10000000:01000000:0.0:1789601394.418079:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789601394.418083:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601394.418085:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601394.418086:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601394.418088:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789601394.418090:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601394.418092:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601394.418093:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601394.418095:0:9517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789601394.418097:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601394.418098:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789601394.418126:0:9517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df501e60000 from lustre-OST0001 10000000:01000000:0.0:1789601394.418166:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789601394.418169:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789601394.418180:0:9517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f3720000 local copy 10000000:01000000:0.0:1789601394.418185:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789601394.418227:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.418239:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.418257:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.418279:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257536:0@lo:101: 00000100:00100000:0.0:1789601394.418319:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.418364:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601394.418459:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257536 00000100:00100000:2.0:1789601394.418466:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257536 00000100:00100000:2.0:1789601394.418522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789601394.418531:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+14:9517:x1876532918257536:12345-0@lo:101: 00010000:00010000:2.0:1789601394.418546:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601394.418585:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f13dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f13d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.418609:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f13dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f13d5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.418619:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f13dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13d5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.418628:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601394.418657:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:9517:x1876532918257536:12345-0@lo:101: Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.418673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789601394.418800:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257536:0@lo:101: 00010000:00010000:0.0:1789601394.418812:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.418822:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.418939:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257664:0@lo:501: 00000100:00100000:0.0:1789601394.418964:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.418985:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601394.419116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257664 00000100:00100000:2.0:1789601394.419121:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257664 00000100:00100000:2.0:1789601394.419153:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789601394.419160:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:9517:x1876532918257664:12345-0@lo:501: 00000100:00100000:2.0:1789601394.419225:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:9517:x1876532918257664:12345-0@lo:501: Request processed in 65us (259us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601394.419232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789601394.419291:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257664:0@lo:501: 10000000:01000000:0.0:1789601394.419304:0:9517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789601394.419321:0:9517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789601394.419326:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419335:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419343:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419377:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601394.419409:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df501e60000 10000000:01000000:0.0:1789601394.419414:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789601394.419420:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789601394.419423:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601394.419427:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789601394.419430:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789601394.419447:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419455:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419463:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.419477:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257792:0@lo:101: 00000100:00100000:0.0:1789601394.419512:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.419535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257792 00000100:00100000:0.0:1789601394.419539:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257792 00000100:00100000:0.0:1789601394.419588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789601394.419595:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:9517:x1876532918257792:12345-0@lo:101: 00010000:00010000:0.0:1789601394.419601:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.419612:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f13e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419627:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419648:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419655:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031a00, rc 0) 00000100:00100000:0.0:1789601394.419687:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918257792:12345-0@lo:101: Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.419693:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789601394.419733:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.419744:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257792:0@lo:101: 00010000:00010000:0.0:1789601394.419753:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.419762:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.419811:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257920:0@lo:501: 00000100:00100000:0.0:1789601394.419832:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.419848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918257920 00000100:00100000:0.0:1789601394.419851:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918257920 00000100:00100000:0.0:1789601394.419865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789601394.419871:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918257920:12345-0@lo:501: 00000100:00100000:0.0:1789601394.419956:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918257920:12345-0@lo:501: Request processed in 85us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.419963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789601394.419980:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.419990:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918257920:0@lo:501: 00000100:00100000:0.0:1789601394.420029:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258048:0@lo:503: 00000100:00100000:0.0:1789601394.420066:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.420083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258048 00000100:00100000:0.0:1789601394.420086:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258048 00000100:00100000:0.0:1789601394.420101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789601394.420106:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258048:12345-0@lo:503: 00000100:00100000:0.0:1789601394.420175:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258048:12345-0@lo:503: Request processed in 68us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.420182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789601394.420211:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.420222:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258048:0@lo:503: 00000040:00080000:0.0:1789601394.420541:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601394.420645:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258176:0@lo:502: 00000100:00100000:0.0:1789601394.420685:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.420708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258176 00000100:00100000:0.0:1789601394.420712:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258176 00000100:00100000:0.0:1789601394.420729:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789601394.420735:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258176:12345-0@lo:502: 00000100:00100000:0.0:1789601394.420805:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258176:12345-0@lo:502: Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.420812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789601394.420843:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.420857:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258176:0@lo:502: 00000040:00080000:0.0:1789601394.421104:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789601394.421132:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789601394.421149:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789601394.421176:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789601394.421190:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789601394.421204:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789601394.421222:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258304:0@lo:502: 00000100:00100000:0.0:1789601394.421260:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.421284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258304 00000100:00100000:0.0:1789601394.421289:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258304 00000100:00100000:0.0:1789601394.421306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789601394.421312:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258304:12345-0@lo:502: 00000100:00100000:0.0:1789601394.421376:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258304:12345-0@lo:502: Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.421382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789601394.421411:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.421425:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258304:0@lo:502: 00000040:00080000:0.0:1789601394.421462:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789601394.421469:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:2.0:1789601394.421978:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601394.421989:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.422007:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601394.422022:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.422033:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601394.422041:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601394.422047:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601394.422074:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.422081:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601394.422107:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.422114:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0031c00/0x74872e3eca9f13d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x74872e3eca9f13dc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.422131:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601394.422133:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601394.422134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.422380:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601394.422397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918258432:0@lo:103: 00000100:00100000:1.0:1789601394.422450:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.422513:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258432 00000100:00100000:1.0:1789601394.422519:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258432 00000100:00100000:1.0:1789601394.422582:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601394.422591:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3647:x1876532918258432:12345-0@lo:103: 00010000:00010000:1.0:1789601394.422604:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601394.422619:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f13dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f13d5 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601394.422632:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601394.422677:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3647:x1876532918258432:12345-0@lo:103: Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.422683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601394.422724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918258432:0@lo:103: 00000020:01000000:2.0:1789601394.423380:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789601394.423392:0:9528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789601394.423401:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601394.423404:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789601394.423411:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601394.423432:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df3c2103380) 00000020:00000080:2.0:1789601394.423472:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789601394.423481:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789601394.423862:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df501e60000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789601394.423874:0:9528:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789601394.423891:0:9528:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74872e3eca9f13f8 00010000:00010000:2.0:1789601394.436254:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789601394.436688:0:9528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789601394.441269:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789601394.443329:0:9528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789601394.456525:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789601394.458199:0:9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789601394.470489:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789601394.478174:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789601394.478193:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601394.478202:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601394.478205:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789601394.478210:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601394.478216:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601394.478218:0:9528:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789601394.478221:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789601394.478224:0:9528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789601394.478260:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601394.478263:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601394.478265:0:9528:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789601394.478268:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789601394.480728:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789601394.480779:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789601394.480806:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.480821:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601394.480831:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df501e60000 from 1 10000000:01000000:2.0:1789601394.480833:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601394.480884:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.480894:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.480905:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.480934:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258560:0@lo:101: 00000100:00100000:2.0:1789601394.481035:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601394.481093:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.482482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258560 00000100:00100000:0.0:1789601394.482508:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258560 00000100:00100000:0.0:1789601394.482590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601394.482601:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:9517:x1876532918258560:12345-0@lo:101: 00010000:00010000:0.0:1789601394.482621:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.482640:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f13ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.482670:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.482682:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.482690:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030c00, rc 0) 00000100:00100000:0.0:1789601394.482767:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258560:12345-0@lo:101: Request processed in 169us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.482774:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601394.482838:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258560:0@lo:101: 00010000:00010000:0.0:1789601394.482858:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.482868:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.483008:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258688:0@lo:501: 00000100:00100000:0.0:1789601394.483043:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.483075:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258688 00000100:00100000:0.0:1789601394.483080:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258688 00000100:00100000:0.0:1789601394.483114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601394.483121:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258688:12345-0@lo:501: 00000100:00100000:0.0:1789601394.483227:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258688:12345-0@lo:501: Request processed in 106us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.483234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601394.483270:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.483285:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258688:0@lo:501: 00000100:00100000:0.0:1789601394.483312:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258816:0@lo:503: 00000100:00100000:0.0:1789601394.483368:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.483388:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258816 00000100:00100000:0.0:1789601394.483391:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258816 00000100:00100000:0.0:1789601394.483412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789601394.483418:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258816:12345-0@lo:503: 00000100:00100000:0.0:1789601394.483492:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258816:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.483514:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789601394.483548:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.483585:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258816:0@lo:503: 00000040:00080000:0.0:1789601394.483853:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601394.483921:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258944:0@lo:502: 00000100:00100000:0.0:1789601394.483957:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.483981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918258944 00000100:00100000:0.0:1789601394.483986:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918258944 00000100:00100000:0.0:1789601394.484006:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789601394.484013:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258944:12345-0@lo:502: 00000100:00100000:0.0:1789601394.484082:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918258944:12345-0@lo:502: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.484096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789601394.484131:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.484144:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918258944:0@lo:502: 00000040:00080000:0.0:1789601394.484336:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789601394.484363:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789601394.484381:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259072:0@lo:502: 00000100:00100000:0.0:1789601394.484414:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.484435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259072 00000100:00100000:0.0:1789601394.484439:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259072 00000100:00100000:0.0:1789601394.484459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789601394.484465:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918259072:12345-0@lo:502: 00000100:00100000:3.0:1789601394.490306:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bfaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.494616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918259072:12345-0@lo:502: Request processed in 10081us (10132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.494634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601394.494782:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259072:0@lo:502: 00000040:00080000:3.0:1789601394.494899:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789601394.494916:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789601394.498433:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601394.498453:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601394.498456:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789601394.498471:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df501e60000 00000020:00000080:1.0:1789601394.498475:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601394.498489:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601394.498492:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601394.498513:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789601394.498518:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789601394.498703:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789601394.498745:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601394.498768:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.498783:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601394.498856:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789601394.498860:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df501e60000 10000000:01000000:0.0:1789601394.498864:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df501e60000 10000000:01000000:0.0:1789601394.498868:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601394.498875:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df501e60000 from 1 10000000:01000000:0.0:1789601394.498884:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789601394.498929:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.498938:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.498951:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.498978:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259200:0@lo:101: 00000100:00100000:0.0:1789601394.499078:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.499123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259200 00000100:00100000:0.0:1789601394.499131:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259200 00000100:00100000:0.0:1789601394.499181:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789601394.499191:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9517:x1876532918259200:12345-0@lo:101: 00010000:00010000:0.0:1789601394.499206:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.499221:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f140d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.499247:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f140d expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.499260:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f140d expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.499269:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031c00, rc 0) 00000100:00100000:0.0:1789601394.499304:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259200:12345-0@lo:101: Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.499311:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789601394.499366:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bfa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.499390:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259200:0@lo:101: 00010000:00010000:0.0:1789601394.499406:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.499416:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.499536:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259328:0@lo:501: 00000100:00100000:0.0:1789601394.499590:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.499613:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259328 00000100:00100000:0.0:1789601394.499616:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259328 00000100:00100000:0.0:1789601394.499642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789601394.499648:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259328:12345-0@lo:501: 00000100:00100000:0.0:1789601394.499759:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259328:12345-0@lo:501: Request processed in 109us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.499766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789601394.499794:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bfa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.499807:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259328:0@lo:501: 00000100:00100000:0.0:1789601394.499833:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259456:0@lo:503: 00000100:00100000:0.0:1789601394.499871:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.499890:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259456 00000100:00100000:0.0:1789601394.499894:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259456 00000100:00100000:0.0:1789601394.499913:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789601394.499920:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259456:12345-0@lo:503: 00000100:00100000:0.0:1789601394.499992:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259456:12345-0@lo:503: Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.500007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789601394.500039:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.500051:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259456:0@lo:503: 00000040:00080000:0.0:1789601394.500337:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601394.500404:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259584:0@lo:502: 00000100:00100000:0.0:1789601394.500443:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.500467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259584 00000100:00100000:0.0:1789601394.500472:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259584 00000100:00100000:0.0:1789601394.500495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789601394.500513:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259584:12345-0@lo:502: 00000100:00100000:0.0:1789601394.500616:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259584:12345-0@lo:502: Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.500623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789601394.500657:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.500670:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259584:0@lo:502: 00000040:00080000:0.0:1789601394.500871:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789601394.500896:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789601394.500907:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789601394.500918:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789601394.500932:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789601394.500944:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789601394.500957:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789601394.500981:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789601394.500994:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789601394.501004:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789601394.501013:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789601394.501023:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789601394.501041:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789601394.501051:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789601394.501061:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789601394.501070:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789601394.501081:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789601394.501093:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789601394.501104:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789601394.501115:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789601394.501127:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789601394.501137:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789601394.501148:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789601394.501170:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789601394.501183:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789601394.501195:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789601394.501207:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789601394.501220:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789601394.501232:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789601394.501244:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789601394.501256:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789601394.501268:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789601394.501281:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789601394.501293:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789601394.501306:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789601394.501319:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789601394.501331:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789601394.501343:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789601394.501356:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789601394.501381:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789601394.501397:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789601394.501410:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789601394.501421:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789601394.501436:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789601394.501449:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789601394.501471:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789601394.506680:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259712:0@lo:502: 00000100:00100000:0.0:1789601394.506787:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918259840:0@lo:13: 00000100:00100000:0.0:1789601394.506868:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.506936:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259840 00000100:00100000:0.0:1789601394.506944:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259840 00000100:00100000:0.0:1789601394.507003:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601394.507025:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918259840:12345-0@lo:13: 00002000:00000024:0.0:1789601394.507058:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601394.507102:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918259840:12345-0@lo:13: Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.507110:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789601394.507131:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601394.507163:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2266300 x1876532918259840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601394.507181:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918259840:0@lo:13: 00000100:00100000:0.0:1789601394.507251:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.507272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259712 00000100:00100000:0.0:1789601394.507276:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259712 00000100:00100000:0.0:1789601394.507301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789601394.507307:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259712:12345-0@lo:502: 00000100:00100000:1.0:1789601394.507695:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918259968:0@lo:400: 00000100:00100000:1.0:1789601394.507735:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918260480:0@lo:400: 00000100:00100000:1.0:1789601394.507777:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507796:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601394.507801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918260352:0@lo:400: 00000100:00100000:1.0:1789601394.507823:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507849:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918260096:0@lo:400: 00000100:00100000:1.0:1789601394.507872:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507889:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918260608:0@lo:400: 00000100:00100000:1.0:1789601394.507907:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507924:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789601394.507929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918260224:0@lo:400: 00000100:00100000:1.0:1789601394.507951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.507969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918260736:0@lo:400: 00000100:00100000:1.0:1789601394.507992:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.508039:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918259968 00000100:00100000:1.0:1789601394.508043:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918259968 00000100:00100000:1.0:1789601394.508071:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260480 00000100:00100000:1.0:1789601394.508074:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260480 00000100:00100000:1.0:1789601394.508097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260608 00000100:00100000:1.0:1789601394.508100:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260608 00000100:00100000:1.0:1789601394.508113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260224 00000100:00100000:1.0:1789601394.508115:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260224 00000100:00100000:1.0:1789601394.508129:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789601394.508137:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918259968:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508190:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918259968:12345-0@lo:400: Request processed in 53us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789601394.508212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601394.508219:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918260480:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508245:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918260480:12345-0@lo:400: Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508251:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601394.508262:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601394.508267:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918260608:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508296:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918260608:12345-0@lo:400: Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508302:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601394.508313:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601394.508319:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918260224:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508461:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918260224:12345-0@lo:400: Request processed in 142us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508468:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601394.508491:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260352 00000100:00100000:1.0:1789601394.508495:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260352 00000100:00100000:1.0:1789601394.508528:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260096 00000100:00100000:1.0:1789601394.508531:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260096 00000100:00100000:1.0:1789601394.508544:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601394.508550:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918260352:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508608:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918260352:12345-0@lo:400: Request processed in 58us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508624:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601394.508636:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601394.508642:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918260096:12345-0@lo:400: 00000100:00100000:1.0:1789601394.508667:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918260096:12345-0@lo:400: Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.508673:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789601394.508699:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601394.508703:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601394.508728:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918260352:0@lo:400: 00010000:00080000:1.0:1789601394.508741:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2809c00 x1876532918259968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.508751:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918259968:0@lo:400: 00010000:00080000:1.0:1789601394.508761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c280a680 x1876532918260480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.508768:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918260480:0@lo:400: 00010000:00080000:1.0:1789601394.508803:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2808380 x1876532918260224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.508812:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918260224:0@lo:400: 00000100:00100000:1.0:1789601394.508821:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918260096:0@lo:400: 00010000:00080000:1.0:1789601394.508830:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2809f80 x1876532918260608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.508838:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918260608:0@lo:400: 00000100:00100000:2.0:1789601394.509033:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260736 00000100:00100000:2.0:1789601394.509037:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260736 00000100:00100000:2.0:1789601394.509110:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601394.509117:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918260736:12345-0@lo:400: 00000100:00100000:2.0:1789601394.509154:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918260736:12345-0@lo:400: Request processed in 38us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.509161:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601394.509433:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918259712:12345-0@lo:502: Request processed in 2124us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.509443:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789601394.509517:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.509536:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918259712:0@lo:502: 00000040:00080000:0.0:1789601394.509662:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789601394.509678:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000100:00100000:1.0:1789601394.510255:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601394.510281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918260864:0@lo:13: 00000100:00100000:1.0:1789601394.510346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789601394.510388:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601394.510416:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c31bbb80 x1876532918260736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.510429:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918260736:0@lo:400: 00000100:00100000:2.0:1789601394.510527:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260864 00000100:00100000:2.0:1789601394.510534:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260864 00000100:00100000:2.0:1789601394.510607:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601394.510617:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918260864:12345-0@lo:13: 00002000:00000024:2.0:1789601394.510639:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601394.510685:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918260864:12345-0@lo:13: Request processed in 69us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.510692:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:01000004:0.0:1789601394.511119:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789601394.511140:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df4f7268000) 00000020:00000080:0.0:1789601394.511170:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789601394.511292:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df501e60000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789601394.511297:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df501e60000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789601394.511300:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df501e60000 3 00010000:00080000:0.0:1789601394.511535:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f7392000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00080000:1.0:1789601394.512820:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c7800 x1876532918260864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.512850:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918260864:0@lo:13: 00010000:00010000:0.0:1789601394.517226:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789601394.517843:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789601394.517900:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789601394.517916:0:9533:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x74872e3eca9f1422 00000100:00080000:0.0:1789601394.517929:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601394.517944:0:9533:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df4f7392000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601394.517984:0:9533:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c2266d80 x1876532918260992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601394.518048:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918260992:0@lo:38: 00000100:00100000:3.0:1789601394.518136:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.518224:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918260992 00000100:00100000:1.0:1789601394.518232:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918260992 00000100:00100000:1.0:1789601394.518271:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601394.518281:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918260992:12345-0@lo:38: 00010000:00080000:1.0:1789601394.518308:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1789601394.518370:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x74872e3eca9f1429 00000004:00100000:1.0:1789601394.518387:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601394.518423:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2a000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789601394.519027:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789601394.535680:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876532918260992:12345-0@lo:38: Request processed in 17386us (17531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.535698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1789601394.536606:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789601394.536627:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8df3c21019c0) 00000020:00000080:2.0:1789601394.536656:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789601394.536776:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df501e60000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601394.536780:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df501e60000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601394.536783:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df501e60000 3 00010000:00080000:2.0:1789601394.536816:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c2b0f800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.148@tcp at head 00000100:00080000:1.0:1789601394.539296:0:9534:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8df3c31bbb80 x1876532918261120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.539314:0:9534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c29a2f00 going to sleep for 0 seconds 00010000:00080000:3.0:1789601394.539610:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c2266d80 x1876532918260992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601394.539623:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601394.539632:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789601394.539643:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789601394.539664:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789601394.539668:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789601394.539675:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006665e5d7): req@ffff8df3c31bbb80 x1876532918261120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601394.539696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918260992:0@lo:38: 00000100:00100000:1.0:1789601394.540189:0:9534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.540241:0:9534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c29a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601394.541584:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261120 00000100:00100000:3.0:1789601394.541598:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261120 00000100:00100000:3.0:1789601394.541677:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601394.541689:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1876532918261120:12345-0@lo:901: 00000100:00100000:3.0:1789601394.541842:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1876532918261120:12345-0@lo:901: Request processed in 155us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.541850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789601394.544280:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601394.544380:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c31bbb80 x1876532918261120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789601410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601394.544400:0:9534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1876532918261120:0@lo:901: 00010000:00010000:2.0:1789601394.546413:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789601394.546706:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789601394.546767:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601394.546781:0:9533:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x74872e3eca9f1437 00000100:00080000:2.0:1789601394.546793:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601394.546807:0:9533:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601394.546845:0:9533:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c5180 x1876532918261248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601394.546887:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789601394.548189:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918261248:0@lo:38: 00000100:00100000:0.0:1789601394.548284:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.551376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261248 00000100:00100000:1.0:1789601394.551397:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261248 00000100:00100000:1.0:1789601394.551465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601394.551476:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876532918261248:12345-0@lo:38: 00010000:00080000:1.0:1789601394.551524:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1789601394.551597:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x74872e3eca9f143e 00000004:00100000:1.0:1789601394.551616:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601394.551657:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601394.551764:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876532918261248:12345-0@lo:38: Request processed in 288us (3479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.551772:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789601394.551953:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c5180 x1876532918261248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601394.551967:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601394.551977:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789601394.551987:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789601394.551993:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789601394.551996:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601394.552031:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918261248:0@lo:38: 00000040:00080000:3.0:1789601394.560950:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789601394.561251:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789601394.561286:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789601394.561312:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.561334:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789601394.561395:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789601394.561398:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601394.561400:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601394.561401:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601394.561403:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601394.561405:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601394.561407:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601394.561408:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601394.561410:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601394.561411:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601394.561413:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789601394.561418:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789601394.561420:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789601394.561422:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601394.561423:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601394.561424:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601394.561425:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601394.561426:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601394.561427:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601394.561428:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601394.561430:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601394.561431:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601394.561432:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789601394.561467:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789601394.561489:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918261376:0@lo:253: 00000100:00100000:2.0:1789601394.561636:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601394.561696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261376 00000100:00100000:2.0:1789601394.561704:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261376 00000100:00100000:2.0:1789601394.561751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789601394.561761:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918261376:12345-0@lo:253: 20000000:01000000:2.0:1789601394.561790:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789601394.561807:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789601394.561965:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07180 going to sleep for 11 seconds 20000000:01000000:2.0:1789601394.570658:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789601394.570683:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789601394.571041:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9517:x1876532918261376:12345-0@lo:253: Request processed in 9275us (9399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.571054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:0.0:1789601394.571266:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789601394.571272:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789601394.571296:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571313:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571322:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f137a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571339:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571384:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571400:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 16 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.571415:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918261504:0@lo:104: 00000100:00100000:0.0:1789601394.571451:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601394.571491:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571510:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.571519:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918261632:0@lo:104: 00000100:00100000:0.0:1789601394.571576:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601394.571593:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601394.571614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261504 00000100:00100000:0.0:1789601394.571621:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261504 00000100:00100000:0.0:1789601394.571660:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261632 00000100:00100000:0.0:1789601394.571663:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261632 00000100:00100000:0.0:1789601394.571685:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601394.571693:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918261504:12345-0@lo:104: 00010000:00010000:0.0:1789601394.571707:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571749:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601394.571754:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:6537:x1876532918261504:12345-0@lo:104: Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.571760:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601394.571772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601394.571777:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918261632:12345-0@lo:104: 00010000:00010000:0.0:1789601394.571784:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571810:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789601394.571814:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:6537:x1876532918261632:12345-0@lo:104: Request processed in 37us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.571820:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789601394.571837:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601394.571843:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571851:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601394.571861:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571871:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601394.571879:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601394.571886:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601394.571912:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571917:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601394.571937:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571945:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f137a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1381 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571961:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601394.571965:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571971:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e0e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601394.571973:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.571979:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601394.571995:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601394.572001:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789601394.572282:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9517:1876532918261376:0@lo:253: 10000000:01000000:1.0:1789601394.572297:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789601394.572300:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601394.572302:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789601394.572303:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601394.572304:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601394.572306:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601394.572307:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601394.572309:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601394.572310:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789601394.572312:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789601394.572314:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601394.572316:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789601394.572340:0:9517:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789601394.573247:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.573265:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601394.573299:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.573309:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e0e00/0x74872e3eca9f1334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f133b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.573513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601394.573515:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601394.573517:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601394.573525:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601394.574871:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918261760:0@lo:103: 00000100:00100000:0.0:1789601394.574970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601394.575457:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261760 00000100:00100000:2.0:1789601394.575469:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261760 00010000:00010000:2.0:1789601394.575526:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.575598:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789601394.575608:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3646:x1876532918261760:12345-0@lo:103: 00010000:00010000:2.0:1789601394.575626:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601394.575632:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.575646:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 17 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.575680:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601394.575729:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3646:x1876532918261760:12345-0@lo:103: Request processed in 123us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.575737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601394.576050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918261760:0@lo:103: 00000100:00100000:0.0:1789601394.576095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918261888:0@lo:103: 00000100:00100000:0.0:1789601394.576131:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601394.576189:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f1381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f137a expref: 16 pid: 6515 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601394.576204:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918261504:0@lo:104: 00000100:00100000:0.0:1789601394.576228:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876532918261632:0@lo:104: 00010000:00010000:0.0:1789601394.576248:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.576770:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918261888 00000100:00100000:2.0:1789601394.576801:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918261888 00010000:00010000:2.0:1789601394.576830:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.576861:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601394.576869:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3647:x1876532918261888:12345-0@lo:103: 00010000:00010000:2.0:1789601394.576880:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601394.576885:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576897:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576912:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee800/0x74872e3eca9f133b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1334 expref: 16 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576928:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576937:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601394.576956:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014887876s 00010000:00010000:2.0:1789601394.576961:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576969:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576977:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.576998:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.577004:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601394.577495:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.577519:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.577543:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601394.577611:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601394.578082:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.578094:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.578101:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f1445 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601394.578798:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3647:x1876532918261888:12345-0@lo:103: Request processed in 1925us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.578810:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601394.579851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918261888:0@lo:103: 00080000:10000000:1.0:1789601394.583965:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789601394.584151:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789601394.584359:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789601394.584526:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789601394.584764:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789601394.584982:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789601394.595840:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789601394.609265:0:9517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789601394.609277:0:9517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789601394.609326:0:9517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789601394.609385:0:9517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789601394.609407:0:9517:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789601394.609442:0:9517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789601394.614385:0:9517:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601394.619378:0:9517:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789601395.334116:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789601395.749177:0:9589:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601395.749766:0:9589:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789601396.357856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601397.062376:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601397.062414:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918262016:0@lo:41: 00000100:00100000:2.0:1789601397.062518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601397.063983:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262016 00000100:00100000:0.0:1789601397.063999:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262016 00000100:00100000:0.0:1789601397.064069:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601397.064080:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918262016:12345-0@lo:41: 00000004:00000024:0.0:1789601397.064139:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789601397.064224:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918262016:12345-0@lo:41: Request processed in 146us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601397.064254:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601397.065101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918262016:0@lo:41: 00010000:00010000:0.0:1789601397.382495:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601397.576589:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918262144:0@lo:41: 00000100:00100000:2.0:1789601397.576682:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601397.576776:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262144 00000100:00100000:2.0:1789601397.576784:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262144 00000100:00100000:2.0:1789601397.576831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601397.576839:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918262144:12345-0@lo:41: 00000004:00000024:2.0:1789601397.576880:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789601397.576927:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918262144:12345-0@lo:41: Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601397.576942:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601397.577028:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918262144:0@lo:41: 00010000:00010000:1.0:1789601398.408093:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601399.440866:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601399.621839:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918262656:0@lo:400: 00000100:00100000:1.0:1789601399.621924:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.621984:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918263168:0@lo:400: 00000100:00100000:1.0:1789601399.622011:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622042:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789601399.622048:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918262272:0@lo:400: 00000100:00100000:1.0:1789601399.622076:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622097:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918262784:0@lo:400: 00000100:00100000:1.0:1789601399.622118:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622134:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918263296:0@lo:400: 00000100:00100000:1.0:1789601399.622152:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918262400:0@lo:400: 00000100:00100000:1.0:1789601399.622214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622234:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918262912:0@lo:400: 00000100:00100000:1.0:1789601399.622255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918263424:0@lo:400: 00000100:00100000:1.0:1789601399.622289:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622307:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789601399.622311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918262528:0@lo:400: 00000100:00100000:1.0:1789601399.622330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918263040:0@lo:400: 00000100:00100000:1.0:1789601399.622377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918263552:0@lo:400: 00000100:00100000:1.0:1789601399.622409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601399.622435:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262656 00000100:00100000:1.0:1789601399.622444:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262656 00000100:00100000:1.0:1789601399.622493:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262400 00000100:00100000:1.0:1789601399.622497:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262400 00000100:00100000:1.0:1789601399.622508:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262912 00000100:00100000:1.0:1789601399.622511:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262912 00000100:00100000:1.0:1789601399.622532:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263424 00000100:00100000:1.0:1789601399.622536:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263424 00000100:00100000:1.0:1789601399.622546:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263040 00000100:00100000:1.0:1789601399.622549:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263040 00000100:00100000:1.0:1789601399.622591:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263552 00000100:00100000:1.0:1789601399.622594:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263552 00000100:00100000:1.0:1789601399.622612:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601399.622620:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918262656:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622678:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918262656:12345-0@lo:400: Request processed in 59us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622685:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601399.622703:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601399.622709:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918262400:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622738:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918262400:12345-0@lo:400: Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622743:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601399.622753:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601399.622759:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918262912:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622782:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918262912:12345-0@lo:400: Request processed in 24us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622794:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601399.622807:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601399.622812:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918263424:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622838:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918263424:12345-0@lo:400: Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622843:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601399.622853:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601399.622858:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918263040:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622882:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918263040:12345-0@lo:400: Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622888:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601399.622898:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601399.622905:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918263552:12345-0@lo:400: 00000100:00100000:1.0:1789601399.622929:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918263552:12345-0@lo:400: Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.622934:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601399.622952:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263168 00000100:00100000:1.0:1789601399.622956:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263168 00000100:00100000:1.0:1789601399.622980:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263296 00000100:00100000:1.0:1789601399.622983:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263296 00000100:00100000:1.0:1789601399.623002:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601399.623009:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918263168:12345-0@lo:400: 00000100:00100000:1.0:1789601399.623039:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918263168:12345-0@lo:400: Request processed in 32us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.623046:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601399.623056:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601399.623069:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918263296:12345-0@lo:400: 00000100:00100000:1.0:1789601399.623095:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918263296:12345-0@lo:400: Request processed in 27us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.623100:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601399.623117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262272 00000100:00100000:1.0:1789601399.623121:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262272 00000100:00100000:1.0:1789601399.623152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789601399.623158:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3645:x1876532918262272:12345-0@lo:400: 00000100:00100000:1.0:1789601399.623184:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3645:x1876532918262272:12345-0@lo:400: Request processed in 27us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.623190:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789601399.623218:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262784 00000100:00100000:1.0:1789601399.623222:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262784 00000100:00100000:1.0:1789601399.623242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918262528 00000100:00100000:1.0:1789601399.623245:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918262528 00000100:00100000:1.0:1789601399.623256:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789601399.623262:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918262784:12345-0@lo:400: 00000100:00100000:1.0:1789601399.623290:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918262784:12345-0@lo:400: Request processed in 29us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.623296:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789601399.623307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789601399.623313:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918262528:12345-0@lo:400: 00000100:00100000:1.0:1789601399.623338:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918262528:12345-0@lo:400: Request processed in 26us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.623344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789601399.623372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601399.623377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601399.623385:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601399.623428:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918262528:0@lo:400: 00010000:00080000:1.0:1789601399.623442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31b8380 x1876532918263040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918263040:0@lo:400: 00010000:00080000:1.0:1789601399.623473:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280aa00 x1876532918263552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918263552:0@lo:400: 00010000:00080000:1.0:1789601399.623492:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb480 x1876532918262400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623499:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918262400:0@lo:400: 00010000:00080000:1.0:1789601399.623509:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31b9c00 x1876532918262912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623516:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918262912:0@lo:400: 00010000:00080000:1.0:1789601399.623524:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2809f80 x1876532918263424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918263424:0@lo:400: 00000100:00100000:1.0:1789601399.623583:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918262272:0@lo:400: 00000100:00100000:1.0:1789601399.623593:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918262784:0@lo:400: 00010000:00080000:1.0:1789601399.623602:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31b9500 x1876532918263296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918263296:0@lo:400: 00010000:00080000:1.0:1789601399.623630:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bad80 x1876532918262656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623638:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918262656:0@lo:400: 00010000:00080000:1.0:1789601399.623647:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31baa00 x1876532918263168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601399.623656:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918263168:0@lo:400: 00000100:00100000:3.0:1789601399.625214:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601399.625233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918263680:0@lo:13: 00000100:00100000:3.0:1789601399.625323:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601399.625417:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263680 00000100:00100000:2.0:1789601399.625426:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263680 00000100:00100000:2.0:1789601399.625488:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601399.625498:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918263680:12345-0@lo:13: 00002000:00000024:2.0:1789601399.625529:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601399.625597:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918263680:12345-0@lo:13: Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601399.625603:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789601399.625699:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c4380 x1876532918263680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601399.625719:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918263680:0@lo:13: 00000100:00100000:3.0:1789601399.626142:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918263808:0@lo:13: 00000100:00100000:3.0:1789601399.626173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601399.626200:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263808 00000100:00100000:3.0:1789601399.626205:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263808 00000100:00100000:3.0:1789601399.626241:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789601399.626248:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918263808:12345-0@lo:13: 00002000:00000024:3.0:1789601399.626262:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601399.626293:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918263808:12345-0@lo:13: Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601399.626299:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789601399.626327:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a39f80 x1876532918263808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601399.626340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918263808:0@lo:13: 00010000:00010000:0.0:1789601400.456249:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789601400.648471:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601400.648479:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f70a3000 from 39 10000000:01000000:2.0:1789601400.648486:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601400.648538:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.648550:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.648579:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.648606:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918263936:0@lo:101: 00000100:00100000:2.0:1789601400.648683:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.648752:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.648824:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918263936 00000100:00100000:3.0:1789601400.648834:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918263936 00000100:00100000:3.0:1789601400.648886:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789601400.648896:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918263936:12345-0@lo:101: 00010000:00010000:3.0:1789601400.648909:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601400.648920:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f144c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.648948:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f144c expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.648959:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f144c expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.648969:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363c00, rc 0) 00000100:00100000:3.0:1789601400.649018:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918263936:12345-0@lo:101: Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.649024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789601400.649319:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918263936:0@lo:101: 00010000:00010000:2.0:1789601400.649336:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.649361:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.649425:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264064:0@lo:501: 00000100:00100000:2.0:1789601400.649465:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.649497:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.649552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264064 00000100:00100000:3.0:1789601400.649591:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264064 00000100:00100000:3.0:1789601400.649616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601400.649623:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918264064:12345-0@lo:501: 00000100:00100000:3.0:1789601400.649744:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918264064:12345-0@lo:501: Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.649752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601400.649781:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264064:0@lo:501: 00000100:00100000:3.0:1789601400.649808:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264192:0@lo:503: 00000100:00100000:3.0:1789601400.649848:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.649862:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.649873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264192 00000100:00100000:3.0:1789601400.649877:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264192 00000100:00100000:3.0:1789601400.649892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601400.649898:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918264192:12345-0@lo:503: 00000100:00100000:3.0:1789601400.649971:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918264192:12345-0@lo:503: Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.649977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601400.650011:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264192:0@lo:503: 00000100:00100000:3.0:1789601400.650360:0:9820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9820:1876532918264320:0@lo:502: 00000100:00100000:3.0:1789601400.650394:0:9820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.650409:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264320 00000100:00100000:3.0:1789601400.650413:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264320 00000100:00100000:3.0:1789601400.650430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601400.650435:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9820:x1876532918264320:12345-0@lo:502: 00000100:00100000:3.0:1789601400.650514:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9820:x1876532918264320:12345-0@lo:502: Request processed in 78us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.650529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601400.650554:0:9820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.650584:0:9820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9820:1876532918264320:0@lo:502: 00000100:00100000:3.0:1789601400.650621:0:9820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9820:1876532918264448:0@lo:502: 00000100:00100000:3.0:1789601400.650652:0:9820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.650670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264448 00000100:00100000:3.0:1789601400.650674:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264448 00000100:00100000:3.0:1789601400.650690:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601400.650695:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9820:x1876532918264448:12345-0@lo:502: 00000100:00100000:3.0:1789601400.650751:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:9820:x1876532918264448:12345-0@lo:502: Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.650757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601400.650781:0:9820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.650792:0:9820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9820:1876532918264448:0@lo:502: 00000040:00080000:3.0:1789601400.650808:0:9820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789601400.650855:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789601400.650870:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601400.650878:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.650887:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601400.650895:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789601400.650898:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789601400.650901:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789601400.650921:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.650933:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.650941:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.653348:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264576:0@lo:101: 00000100:00100000:3.0:1789601400.653421:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.653505:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.660609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264576 00000100:00100000:2.0:1789601400.660626:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264576 00000100:00100000:3.0:1789601400.660758:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601400.660770:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918264576:12345-0@lo:101: 00010000:00010000:3.0:1789601400.660788:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601400.660807:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f145a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.660841:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f145a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.660852:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f145a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.660863:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362c00, rc 0) 00000100:00100000:3.0:1789601400.661021:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918264576:12345-0@lo:101: Request processed in 253us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.661038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789601400.667376:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264576:0@lo:101: 00010000:00010000:2.0:1789601400.667411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.667425:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.671350:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264704:0@lo:501: 00000100:00100000:3.0:1789601400.671426:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.671490:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.671527:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264704 00000100:00100000:3.0:1789601400.671536:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264704 00000100:00100000:3.0:1789601400.671611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789601400.671621:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918264704:12345-0@lo:501: 00000100:00100000:3.0:1789601400.671756:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918264704:12345-0@lo:501: Request processed in 136us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.671765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789601400.671812:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264704:0@lo:501: 00000100:00100000:3.0:1789601400.671844:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264832:0@lo:503: 00000100:00100000:3.0:1789601400.671886:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.671900:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.671913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264832 00000100:00100000:3.0:1789601400.671917:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264832 00000100:00100000:3.0:1789601400.671941:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789601400.671948:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918264832:12345-0@lo:503: 00000100:00100000:3.0:1789601400.672025:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918264832:12345-0@lo:503: Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.672044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789601400.672082:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918264832:0@lo:503: 00000100:00100000:3.0:1789601400.672300:0:9821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9821:1876532918264960:0@lo:502: 00000100:00100000:3.0:1789601400.672336:0:9821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.672355:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918264960 00000100:00100000:3.0:1789601400.672358:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918264960 00000100:00100000:3.0:1789601400.672380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789601400.672387:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9821:x1876532918264960:12345-0@lo:502: 00000100:00100000:3.0:1789601400.672474:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9821:x1876532918264960:12345-0@lo:502: Request processed in 87us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.672480:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789601400.672509:0:9821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.672521:0:9821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9821:1876532918264960:0@lo:502: 00000020:01000000:3.0:1789601400.672541:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601400.672549:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601400.672552:0:9821:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601400.672576:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601400.672578:0:9821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789601400.672593:0:9821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9821:1876532918265088:0@lo:502: 00000100:00100000:3.0:1789601400.672619:0:9821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.672636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265088 00000100:00100000:3.0:1789601400.672639:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265088 00000100:00100000:3.0:1789601400.672657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789601400.672663:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9821:x1876532918265088:12345-0@lo:502: 00000100:00100000:3.0:1789601400.672717:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:9821:x1876532918265088:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.672723:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789601400.672749:0:9821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.672760:0:9821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9821:1876532918265088:0@lo:502: 00000020:01000000:3.0:1789601400.672774:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601400.672778:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601400.672780:0:9821:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789601400.672783:0:9821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789601400.672829:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789601400.672845:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789601400.672854:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.672872:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601400.672882:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789601400.672885:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f8b56000 from 39 10000000:01000000:3.0:1789601400.672887:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601400.672911:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.672920:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.672930:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.672941:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265216:0@lo:101: 00000100:00100000:3.0:1789601400.672964:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.672976:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.672987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265216 00000100:00100000:3.0:1789601400.672990:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265216 00000100:00100000:3.0:1789601400.673010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789601400.673016:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918265216:12345-0@lo:101: 00010000:00010000:3.0:1789601400.673024:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601400.673035:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1468 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.673058:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.673081:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.673089:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362600, rc 0) 00000100:00100000:3.0:1789601400.673117:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265216:12345-0@lo:101: Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.673123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789601400.673152:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265216:0@lo:101: 00010000:00010000:3.0:1789601400.673163:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.673173:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.673213:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265344:0@lo:501: 00000100:00100000:3.0:1789601400.673236:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.673249:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.673259:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265344 00000100:00100000:3.0:1789601400.673262:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265344 00000100:00100000:3.0:1789601400.673278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789601400.673283:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265344:12345-0@lo:501: 00000100:00100000:3.0:1789601400.673352:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265344:12345-0@lo:501: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.673358:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789601400.673385:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265344:0@lo:501: 00000100:00100000:3.0:1789601400.673406:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265472:0@lo:503: 00000100:00100000:3.0:1789601400.673439:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.673450:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.673471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265472 00000100:00100000:3.0:1789601400.673475:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265472 00000100:00100000:3.0:1789601400.673489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601400.673494:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265472:12345-0@lo:503: 00000100:00100000:3.0:1789601400.673550:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265472:12345-0@lo:503: Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.673576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601400.673613:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265472:0@lo:503: 00000100:00100000:0.0:1789601400.684774:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9822:1876532918265600:0@lo:502: 00000100:00100000:0.0:1789601400.684865:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.684913:0:9822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d10576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.685041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265600 00000100:00100000:3.0:1789601400.685050:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265600 00000100:00100000:3.0:1789601400.685103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789601400.685113:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:9822:x1876532918265600:12345-0@lo:502: 00000100:00100000:3.0:1789601400.685511:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:9822:x1876532918265600:12345-0@lo:502: Request processed in 398us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.685518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789601400.685638:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9822:1876532918265600:0@lo:502: 00000100:00100000:0.0:1789601400.685686:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9822:1876532918265728:0@lo:502: 00000100:00100000:0.0:1789601400.685718:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.685738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265728 00000100:00100000:0.0:1789601400.685742:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265728 00000100:00100000:0.0:1789601400.685802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789601400.685809:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:9822:x1876532918265728:12345-0@lo:502: 00000100:00100000:0.0:1789601400.685872:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:9822:x1876532918265728:12345-0@lo:502: Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.685878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789601400.686786:0:9822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d10576c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.686809:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9822:1876532918265728:0@lo:502: 00000040:00080000:1.0:1789601400.686834:0:9822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789601400.688894:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789601400.688929:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601400.688941:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.688954:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601400.688964:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601400.688967:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4f8b56000 from 6 10000000:01000000:3.0:1789601400.688970:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601400.689022:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.689044:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.689056:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.689079:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265856:0@lo:101: 00000100:00100000:3.0:1789601400.689397:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.689510:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.689819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265856 00000100:00100000:0.0:1789601400.689829:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265856 00000100:00100000:0.0:1789601400.689882:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789601400.689893:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918265856:12345-0@lo:101: 00010000:00010000:0.0:1789601400.689908:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601400.689923:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f147d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1476 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.689965:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f147d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1476 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.689977:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f147d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1476 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.689989:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030800, rc 0) 00000100:00100000:0.0:1789601400.690049:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918265856:12345-0@lo:101: Request processed in 158us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.690057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789601400.690644:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265856:0@lo:101: 00010000:00010000:3.0:1789601400.690661:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.690671:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.690727:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265984:0@lo:256: 00000100:00100000:3.0:1789601400.690763:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.690782:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.692327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918265984 00000100:00100000:0.0:1789601400.692338:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918265984 00000100:00100000:0.0:1789601400.692391:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789601400.692399:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918265984:12345-0@lo:256: 20000000:01000000:0.0:1789601400.692420:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789601400.692437:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789601400.692440:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789601400.692545:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918265984:12345-0@lo:256: Request processed in 147us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.692578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789601400.692632:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918265984:0@lo:256: 10000000:01000000:0.0:1789601400.692677:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601400.692686:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692697:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601400.692715:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789601400.692718:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789601400.692720:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789601400.692758:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692765:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692775:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601400.692789:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266112:0@lo:101: 00000100:00100000:0.0:1789601400.692816:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.692839:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.692848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266112 00000100:00100000:0.0:1789601400.692851:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266112 00000100:00100000:0.0:1789601400.692866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789601400.692871:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918266112:12345-0@lo:101: 00010000:00010000:0.0:1789601400.692879:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601400.692888:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1484 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692907:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692916:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.692934:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466600, rc 0) 00000100:00100000:0.0:1789601400.692957:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266112:12345-0@lo:101: Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.692963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789601400.692990:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266112:0@lo:101: 00010000:00010000:0.0:1789601400.693001:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601400.693010:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601400.693053:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266240:0@lo:501: 00000100:00100000:0.0:1789601400.693073:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.693083:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.693091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266240 00000100:00100000:0.0:1789601400.693094:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266240 00000100:00100000:0.0:1789601400.693106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601400.693111:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266240:12345-0@lo:501: 00000100:00100000:0.0:1789601400.694421:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266240:12345-0@lo:501: Request processed in 1306us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.694431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601400.694491:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266240:0@lo:501: 00000100:00100000:0.0:1789601400.694529:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266368:0@lo:503: 00000100:00100000:0.0:1789601400.694584:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.694607:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.694778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266368 00000100:00100000:0.0:1789601400.694784:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266368 00000100:00100000:0.0:1789601400.694813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601400.694819:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266368:12345-0@lo:503: 00000100:00100000:0.0:1789601400.694912:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266368:12345-0@lo:503: Request processed in 93us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.694918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601400.694955:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266368:0@lo:503: 00000100:00100000:0.0:1789601400.695900:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9823:1876532918266496:0@lo:502: 00000100:00100000:0.0:1789601400.695944:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.696010:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.702828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266496 00000100:00100000:1.0:1789601400.702845:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266496 00000100:00100000:1.0:1789601400.702974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789601400.702985:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:9823:x1876532918266496:12345-0@lo:502: 00000100:00100000:1.0:1789601400.703182:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:9823:x1876532918266496:12345-0@lo:502: Request processed in 198us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.703191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789601400.703318:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9823:1876532918266496:0@lo:502: 00000020:01000000:0.0:1789601400.703359:0:9823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789601400.703367:0:9823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789601400.703374:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601400.703376:0:9823:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789601400.703382:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601400.703385:0:9823:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:0.0:1789601400.703412:0:9823:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789601400.703415:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601400.703433:0:9823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8df4f726cd40) 00000020:00000080:0.0:1789601400.703471:0:9823:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789601400.703478:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601400.703581:0:9823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789601400.703588:0:9823:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789601400.703594:0:9823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f1499 00010000:00080000:0.0:1789601400.704438:0:9823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f7345800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789601400.704907:0:9823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789601400.711162:0:9823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789601400.711193:0:9823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789601400.711412:0:9823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601400.711581:0:9823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601400.711728:0:9823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789601400.711832:0:9823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789601400.723440:0:9826:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601400.723448:0:9826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789601400.724222:0:9823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601400.724234:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789601400.724274:0:9823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789601400.724300:0:9823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f14a0 00000100:00080000:2.0:1789601400.724311:0:9823:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601400.724324:0:9823:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4f7345800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601400.724366:0:9823:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6300 x1876532918266624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601400.724397:0:9823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789601400.724451:0:9823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601400.724471:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.724473:0:9823:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789601400.724477:0:9823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601400.724482:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.724484:0:9823:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601400.724487:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601400.724489:0:9823:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789601400.724520:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9823:1876532918266752:0@lo:502: 00000100:00100000:3.0:1789601400.724861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918266624:0@lo:8: 00000100:00100000:3.0:1789601400.724900:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.724977:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.725005:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.725058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266752 00000100:00100000:3.0:1789601400.725066:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266752 00000100:00100000:3.0:1789601400.725119:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789601400.725129:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:9823:x1876532918266752:12345-0@lo:502: 00000100:00100000:3.0:1789601400.725264:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:9823:x1876532918266752:12345-0@lo:502: Request processed in 136us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.725278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789601400.725463:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9823:1876532918266752:0@lo:502: 00000020:01000000:2.0:1789601400.725489:0:9823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601400.725493:0:9823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.725495:0:9823:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789601400.725498:0:9823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789601400.725765:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789601400.725787:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789601400.725797:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.725808:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601400.725819:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789601400.725822:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4d017d800 from 39 10000000:01000000:3.0:1789601400.725825:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601400.725852:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.725861:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.725870:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.725886:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266880:0@lo:101: 00000100:00100000:3.0:1789601400.725915:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.725948:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.727148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266880 00000100:00100000:2.0:1789601400.727158:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266880 00000100:00100000:2.0:1789601400.727214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789601400.727226:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918266880:12345-0@lo:101: 00010000:00010000:2.0:1789601400.727238:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601400.727253:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f14a7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.727279:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.727290:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.727298:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382c00, rc 0) 00000100:00100000:2.0:1789601400.727368:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918266880:12345-0@lo:101: Request processed in 143us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.727373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789601400.727420:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918266880:0@lo:101: 00010000:00010000:2.0:1789601400.727434:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.727442:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.727517:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918267008:0@lo:501: 00000100:00100000:2.0:1789601400.727545:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.727576:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.727589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267008 00000100:00100000:2.0:1789601400.727593:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267008 00000100:00100000:2.0:1789601400.727615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789601400.727796:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918267008:12345-0@lo:501: 00000100:00100000:2.0:1789601400.727905:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918267008:12345-0@lo:501: Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.727912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789601400.727943:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918267008:0@lo:501: 00000100:00100000:2.0:1789601400.727969:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918267136:0@lo:503: 00000100:00100000:2.0:1789601400.728007:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.728020:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.728162:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267136 00000100:00100000:3.0:1789601400.728167:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267136 00000100:00100000:3.0:1789601400.728187:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789601400.728204:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918267136:12345-0@lo:503: 00000100:00100000:1.0:1789601400.731106:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918266624 00000100:00100000:1.0:1789601400.731119:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918266624 00000100:00100000:1.0:1789601400.731160:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601400.731169:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918266624:12345-0@lo:8: 00010000:00080000:1.0:1789601400.731210:0:8441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1789601400.731239:0:8441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f14b5 00002000:00100000:1.0:1789601400.731253:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8df3c298f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789601400.731258:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789601400.731268:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789601400.731334:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789601400.731585:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789601400.731617:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8df3c298e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601400.731711:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918266624:12345-0@lo:8: Request processed in 542us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.731720:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601400.731765:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918267264:0@lo:400: 00000100:00100000:1.0:1789601400.731802:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.731826:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918267776:0@lo:400: 00000100:00100000:1.0:1789601400.731843:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.731856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918268288:0@lo:400: 00000100:00100000:1.0:1789601400.731873:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.731891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789601400.731896:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918267392:0@lo:400: 00000100:00100000:1.0:1789601400.731916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.731932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918267904:0@lo:400: 00000100:00100000:1.0:1789601400.731950:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.731965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918268416:0@lo:400: 00000100:00100000:1.0:1789601400.731985:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.732008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918267520:0@lo:400: 00000100:00100000:1.0:1789601400.732030:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.732042:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918268032:0@lo:400: 00000100:00100000:1.0:1789601400.732061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.732078:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789601400.732083:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918267648:0@lo:400: 00000100:00100000:1.0:1789601400.732111:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.732126:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918268160:0@lo:400: 00000100:00100000:1.0:1789601400.732145:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.732172:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268032 00000100:00100000:1.0:1789601400.732178:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268032 00000100:00100000:1.0:1789601400.732208:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268160 00000100:00100000:1.0:1789601400.732211:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268160 00000100:00100000:1.0:1789601400.732226:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601400.732232:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918268032:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732267:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918268032:12345-0@lo:400: Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732272:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601400.732282:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601400.732287:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918268160:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732325:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918268160:12345-0@lo:400: Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732331:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601400.732346:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267264 00000100:00100000:1.0:1789601400.732349:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267264 00000100:00100000:1.0:1789601400.732363:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267776 00000100:00100000:1.0:1789601400.732365:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267776 00000100:00100000:1.0:1789601400.732373:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268288 00000100:00100000:1.0:1789601400.732375:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268288 00000100:00100000:1.0:1789601400.732382:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267904 00000100:00100000:1.0:1789601400.732384:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267904 00000100:00100000:1.0:1789601400.732392:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268416 00000100:00100000:1.0:1789601400.732394:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268416 00000100:00100000:1.0:1789601400.732402:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267520 00000100:00100000:1.0:1789601400.732404:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267520 00000100:00100000:1.0:1789601400.732413:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601400.732424:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918267264:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732465:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918267264:12345-0@lo:400: Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732471:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601400.732484:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601400.732489:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918267776:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732515:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918267776:12345-0@lo:400: Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732521:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601400.732530:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601400.732535:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918268288:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732583:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918268288:12345-0@lo:400: Request processed in 47us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732589:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601400.732600:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601400.732606:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918267904:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732631:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918267904:12345-0@lo:400: Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732637:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601400.732648:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601400.732653:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918268416:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732677:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918268416:12345-0@lo:400: Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732683:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601400.732692:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601400.732698:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918267520:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732731:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918267520:12345-0@lo:400: Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732737:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601400.732758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267392 00000100:00100000:1.0:1789601400.732762:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267392 00000100:00100000:1.0:1789601400.732780:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918267648 00000100:00100000:1.0:1789601400.732782:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918267648 00000100:00100000:1.0:1789601400.732791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789601400.732796:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918267392:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732822:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918267392:12345-0@lo:400: Request processed in 26us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732827:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789601400.732836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789601400.732841:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918267648:12345-0@lo:400: 00000100:00100000:1.0:1789601400.732860:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918267648:12345-0@lo:400: Request processed in 19us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.732865:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789601400.732911:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918267648:0@lo:400: 00010000:00080000:1.0:1789601400.732926:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3440e00 x1876532918268160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.732936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918268160:0@lo:400: 00010000:00080000:1.0:1789601400.732943:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3442680 x1876532918267520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.732950:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918267520:0@lo:400: 00010000:00080000:1.0:1789601400.732959:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3443800 x1876532918268032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.732974:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918268032:0@lo:400: 00000100:00100000:1.0:1789601400.733009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918267392:0@lo:400: 00010000:00080000:1.0:1789601400.733018:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3441880 x1876532918267904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733027:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918267904:0@lo:400: 00010000:00080000:1.0:1789601400.733035:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3440000 x1876532918268416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918268416:0@lo:400: 00010000:00080000:1.0:1789601400.733051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3440a80 x1876532918267264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918267264:0@lo:400: 00010000:00080000:1.0:1789601400.733066:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3441180 x1876532918267776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733074:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918267776:0@lo:400: 00010000:00080000:1.0:1789601400.733084:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3443480 x1876532918268288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918268288:0@lo:400: 00010000:00080000:1.0:1789601400.733134:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6300 x1876532918266624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.733143:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601400.733152:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789601400.733167:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789601400.733172:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789601400.733175:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7345800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789601400.733192:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789601400.733199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918266624:0@lo:8: 00000004:00080000:1.0:1789601400.733243:0:9826:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789601400.733316:0:9826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 268854758939ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789601400.733322:0:9826:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789601400.734809:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918267136:12345-0@lo:503: Request processed in 6609us (6795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.734834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789601400.734927:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918268544:0@lo:700: 00000100:00100000:3.0:1789601400.734975:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.735009:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.735128:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268544 00000100:00100000:1.0:1789601400.735145:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268544 00000100:00080000:3.0:1789601400.735590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601400.735668:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601400.735681:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9827:x1876532918268544:12345-0@lo:700: 00000100:00100000:1.0:1789601400.735720:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1876532918268672:0@lo:700: 00000100:00100000:1.0:1789601400.735754:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.735771:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f739b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.735882:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268672 00000100:00100000:3.0:1789601400.735887:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268672 00000100:00100000:3.0:1789601400.735923:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601400.735931:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1876532918268672:12345-0@lo:700: 00000100:00100000:2.0:1789601400.736166:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918267136:0@lo:503: 00000100:00100000:2.0:1789601400.736751:0:9828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9828:1876532918268800:0@lo:502: 00000100:00100000:2.0:1789601400.736814:0:9828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.736847:0:9828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.737552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268800 00000100:00100000:3.0:1789601400.737589:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268800 00000100:00100000:3.0:1789601400.737708:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789601400.737718:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:9828:x1876532918268800:12345-0@lo:502: 00000100:00100000:3.0:1789601400.737859:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:9828:x1876532918268800:12345-0@lo:502: Request processed in 142us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.737867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789601400.738345:0:9828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9828:1876532918268800:0@lo:502: 00000100:00100000:1.0:1789601400.738405:0:9828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9828:1876532918268928:0@lo:502: 00000100:00100000:1.0:1789601400.738447:0:9828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.738483:0:9828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f739bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.741176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918268928 00000100:00100000:3.0:1789601400.741192:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918268928 00000100:00100000:3.0:1789601400.741257:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789601400.741268:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:9828:x1876532918268928:12345-0@lo:502: 00000100:00100000:3.0:1789601400.741423:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:9828:x1876532918268928:12345-0@lo:502: Request processed in 157us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.741431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789601400.741515:0:9828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9828:1876532918268928:0@lo:502: 00000040:00080000:3.0:1789601400.741552:0:9828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789601400.741642:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789601400.741670:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601400.741681:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.741693:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601400.741703:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601400.741706:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4d017d800 from 6 10000000:01000000:3.0:1789601400.741708:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601400.741741:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.741750:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.741760:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.741778:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269056:0@lo:101: 00000100:00100000:3.0:1789601400.741813:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.741844:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e0db9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.746707:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269056 00000100:00100000:2.0:1789601400.746724:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269056 00000100:00100000:2.0:1789601400.746785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789601400.746796:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918269056:12345-0@lo:101: 00010000:00010000:2.0:1789601400.746814:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601400.746832:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382800/0x74872e3eca9f14c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f14bc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.746868:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382800/0x74872e3eca9f14c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f14bc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.746880:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382800/0x74872e3eca9f14c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14bc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.746890:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382800, rc 0) 00000100:00100000:2.0:1789601400.746963:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918269056:12345-0@lo:101: Request processed in 169us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.746975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789601400.747399:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269056:0@lo:101: 00010000:00010000:2.0:1789601400.747420:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.747431:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.747512:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269184:0@lo:256: 00000100:00100000:2.0:1789601400.747604:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.747698:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.747841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269184 00000100:00100000:2.0:1789601400.747847:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269184 00000100:00100000:2.0:1789601400.747876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789601400.747883:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918269184:12345-0@lo:256: 20000000:01000000:2.0:1789601400.747899:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601400.747915:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601400.747919:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789601400.748330:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918269184:12345-0@lo:256: Request processed in 446us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.748339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789601400.748418:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269184:0@lo:256: 10000000:01000000:2.0:1789601400.748472:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601400.748481:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.748491:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601400.748501:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789601400.748504:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789601400.748507:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601400.748532:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.748540:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.748582:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.748598:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269312:0@lo:101: 40000000:02000000:3.0:1789601400.749257:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1789601400.750431:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.750484:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.751749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269312 00000100:00100000:2.0:1789601400.751761:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269312 00000100:00100000:2.0:1789601400.751811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789601400.751821:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918269312:12345-0@lo:101: 00010000:00010000:2.0:1789601400.751837:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601400.751856:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f14ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.751887:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.751898:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.751908:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382400, rc 0) 00000100:00100000:2.0:1789601400.753701:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918269312:12345-0@lo:101: Request processed in 1306us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.753715:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789601400.753801:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269312:0@lo:101: 00010000:00010000:2.0:1789601400.753827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.753852:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.753935:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269440:0@lo:501: 00000100:00100000:2.0:1789601400.753982:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.754005:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.754019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269440 00000100:00100000:2.0:1789601400.754024:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269440 00000100:00100000:2.0:1789601400.756387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601400.756400:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918269440:12345-0@lo:501: 00000100:00100000:2.0:1789601400.756589:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918269440:12345-0@lo:501: Request processed in 191us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.756599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601400.756659:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269440:0@lo:501: 00000100:00100000:2.0:1789601400.756709:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269568:0@lo:503: 00000100:00100000:2.0:1789601400.756758:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.756779:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.756792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269568 00000100:00100000:2.0:1789601400.756799:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269568 00000100:00100000:2.0:1789601400.756821:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789601400.756827:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918269568:12345-0@lo:503: 00000100:00100000:2.0:1789601400.756907:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918269568:12345-0@lo:503: Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.756914:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789601400.756953:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918269568:0@lo:503: 00000004:00080000:2.0:1789601400.757117:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789601400.759870:0:9829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9829:1876532918269696:0@lo:502: 00000100:00100000:2.0:1789601400.759949:0:9829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.759988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269696 00000100:00100000:2.0:1789601400.759996:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269696 00000100:00100000:2.0:1789601400.760048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789601400.760058:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:9829:x1876532918269696:12345-0@lo:502: 00000100:00100000:2.0:1789601400.760168:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:9829:x1876532918269696:12345-0@lo:502: Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.760176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789601400.760346:0:9829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.760368:0:9829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9829:1876532918269696:0@lo:502: 00000020:01000000:2.0:1789601400.760393:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789601400.760400:0:9829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789601400.760407:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.760409:0:9829:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789601400.760413:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789601400.760417:0:9829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:2.0:1789601400.760435:0:9829:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789601400.760437:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601400.760461:0:9829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df3c2100000) 00000020:00000080:2.0:1789601400.760484:0:9829:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789601400.760488:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789601400.760578:0:9829:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789601400.760584:0:9829:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789601400.760590:0:9829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f14df 00010000:00080000:2.0:1789601400.760711:0:9829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c2af8800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1789601400.760959:0:9829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789601400.762798:0:9829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789601400.762816:0:9829:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789601400.763949:0:9829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601400.764866:0:9829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601400.764999:0:9829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789601400.765821:0:9829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1789601400.770541:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1876532918268672:12345-0@lo:700: Request processed in 34602us (34777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.770592:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789601400.770730:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb480 x1876532918268672/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.770747:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1876532918268672:0@lo:700: 40000000:02000000:3.0:1789601400.770771:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1789601400.771211:0:9830:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601400.771216:0:9830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789601400.791677:0:9829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601400.791692:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789601400.791736:0:9829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789601400.791762:0:9829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f14e6 00000100:00080000:0.0:1789601400.791774:0:9829:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601400.791785:0:9829:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2af8800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601400.791826:0:9829:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c2264380 x1876532918269824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601400.791863:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918269824:0@lo:8: 00000100:00100000:0.0:1789601400.791925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.791994:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269824 00000100:00100000:0.0:1789601400.792002:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269824 00000100:00100000:0.0:1789601400.793122:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601400.793131:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876532918269824:12345-0@lo:8: 00010000:00080000:0.0:1789601400.793164:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1789601400.793192:0:8440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f14ed 00002000:00100000:0.0:1789601400.793275:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df4f8d3f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789601400.793279:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789601400.793282:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789601400.793350:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601400.793385:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8df3c354c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601400.793450:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918269824:12345-0@lo:8: Request processed in 318us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.793478:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789601400.793531:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2264380 x1876532918269824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601400.793542:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601400.793549:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789601400.793574:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789601400.793580:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789601400.793582:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2af8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789601400.793598:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789601400.793604:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918269824:0@lo:8: 00000004:00080000:1.0:1789601400.794020:0:9830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1789601400.794919:0:9829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789601400.795003:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601400.795009:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.795011:0:9829:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789601400.795015:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601400.795019:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.795021:0:9829:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601400.795025:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601400.795038:0:9829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789601400.795079:0:9829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9829:1876532918269952:0@lo:502: 00000100:00100000:2.0:1789601400.795156:0:9829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.795187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918269952 00000100:00100000:2.0:1789601400.795478:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918269952 00000100:00100000:2.0:1789601400.795529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789601400.795538:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:9829:x1876532918269952:12345-0@lo:502: 00000100:00100000:2.0:1789601400.795704:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:9829:x1876532918269952:12345-0@lo:502: Request processed in 166us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601400.795713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789601400.795827:0:9829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601400.795850:0:9829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:9829:1876532918269952:0@lo:502: 00000020:01000000:2.0:1789601400.795879:0:9829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601400.795883:0:9829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601400.795885:0:9829:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789601400.795889:0:9829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789601400.795954:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789601400.795977:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789601400.795988:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.796001:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601400.796011:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789601400.796014:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f3720000 from 1 10000000:01000000:2.0:1789601400.796018:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789601400.796058:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.796068:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.796079:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601400.796094:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918270080:0@lo:101: 00000004:00080000:1.0:1789601400.796524:0:9830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268917965584ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789601400.796532:0:9830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789601400.797844:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601400.797890:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.798594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270080 00000100:00100000:3.0:1789601400.798605:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270080 00000100:00100000:3.0:1789601400.798735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789601400.798745:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918270080:12345-0@lo:101: 00010000:00010000:3.0:1789601400.798762:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601400.798779:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f14f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.798808:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.798820:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.798830:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363800, rc 0) 00000100:00100000:3.0:1789601400.798879:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918270080:12345-0@lo:101: Request processed in 136us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.798886:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789601400.798938:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918270080:0@lo:101: 00010000:00010000:3.0:1789601400.798954:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601400.798966:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601400.799913:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918270208:0@lo:501: 00000100:00100000:3.0:1789601400.799954:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.799989:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.800587:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270208 00000100:00100000:0.0:1789601400.800594:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270208 00000100:00100000:0.0:1789601400.800768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789601400.800778:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918270208:12345-0@lo:501: 00000100:00100000:0.0:1789601400.800880:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918270208:12345-0@lo:501: Request processed in 104us (924us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601400.800888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789601400.801295:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918270208:0@lo:501: 10000000:01000000:2.0:1789601400.801337:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789601400.801347:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601400.801358:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601400.803095:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789601400.805915:0:9831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789601400.805949:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918270464:0@lo:7: 00000100:00100000:0.0:1789601400.806019:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.806059:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc780 going to sleep for 11 seconds 00000001:00100000:0.0:1789601400.807944:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789601400.808223:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918268544:12345-0@lo:700: Request processed in 72542us (73244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.808235:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789601400.808286:0:9827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a38a80 x1876532918268544/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.808302:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918268544:0@lo:700: 00000100:00100000:1.0:1789601400.808569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918270336:0@lo:13: 00000100:00100000:1.0:1789601400.808615:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601400.808738:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270464 00000100:00100000:1.0:1789601400.808753:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270464 00000100:00100000:1.0:1789601400.808860:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601400.808870:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9831:x1876532918270464:12345-0@lo:7: 00000100:00100000:3.0:1789601400.809726:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270336 00000100:00100000:3.0:1789601400.809733:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270336 00000100:00100000:3.0:1789601400.809770:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601400.809779:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918270336:12345-0@lo:13: 00002000:00000024:3.0:1789601400.809798:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:3.0:1789601400.809856:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918270336:12345-0@lo:13: Request processed in 78us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.809863:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789601400.809911:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2264380 x1876532918270336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.809930:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918270336:0@lo:13: 00000100:00080000:0.0:1789601400.814740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789601400.816434:0:8857:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789601400.816441:0:8857:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789601400.816610:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9831:x1876532918270464:12345-0@lo:7: Request processed in 7736us (10585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.816621:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789601400.816982:0:9831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265f80 x1876532918270464/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.817000:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918270464:0@lo:7: 00000004:00080000:3.0:1789601400.817019:0:9831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789601400.817075:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918270592:0@lo:5: 00000100:00100000:3.0:1789601400.817112:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.817145:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.818235:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270592 00000100:00100000:1.0:1789601400.818244:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270592 00000100:00100000:1.0:1789601400.818294:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601400.818304:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9831:x1876532918270592:12345-0@lo:5: 00002000:00080000:1.0:1789601400.818330:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789601400.818334:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:3.0:1789601400.820253:0:9827:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789601400.820290:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918270848:0@lo:7: 00000100:00100000:3.0:1789601400.820349:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.820388:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.820404:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601400.820416:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918270720:0@lo:13: 00000100:00100000:3.0:1789601400.820442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.820483:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270848 00000100:00100000:3.0:1789601400.820490:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270848 00000100:00100000:3.0:1789601400.820529:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601400.820537:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918270848:12345-0@lo:7: 00000100:00100000:1.0:1789601400.823815:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270720 00000100:00100000:1.0:1789601400.823829:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270720 00000100:00100000:1.0:1789601400.823891:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601400.823903:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876532918270720:12345-0@lo:13: 00002000:00000024:1.0:1789601400.823929:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:1.0:1789601400.824022:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876532918270720:12345-0@lo:13: Request processed in 120us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601400.824041:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789601400.824096:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23ff800 x1876532918270720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.824121:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918270720:0@lo:13: 00002000:00080000:3.0:1789601400.826827:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789601400.826837:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789601400.826924:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918270848:12345-0@lo:7: Request processed in 6384us (6571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.826935:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789601400.827001:0:9827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23fd180 x1876532918270848/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.827019:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918270848:0@lo:7: 00000004:00080000:3.0:1789601400.827047:0:9827:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789601400.827091:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918270976:0@lo:5: 00000100:00100000:3.0:1789601400.827126:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.827155:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.827273:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918270976 00000100:00100000:3.0:1789601400.827282:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918270976 00000100:00100000:3.0:1789601400.827323:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601400.827333:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918270976:12345-0@lo:5: 00002000:00080000:3.0:1789601400.827359:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789601400.827398:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918270976:12345-0@lo:5: Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.827405:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789601400.827428:0:9827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23fd180 x1876532918270976/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.827439:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918270976:0@lo:5: 00000004:00080000:3.0:1789601400.827447:0:9827:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789601400.827486:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918271104:0@lo:5: 00000100:00100000:3.0:1789601400.827509:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.827518:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601400.827529:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271104 00000100:00100000:3.0:1789601400.827533:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271104 00000100:00100000:3.0:1789601400.827550:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601400.827584:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9827:x1876532918271104:12345-0@lo:5: 00002000:00080000:3.0:1789601400.827607:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:3.0:1789601400.829313:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789601400.829326:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789601400.834512:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9827:x1876532918271104:12345-0@lo:5: Request processed in 6949us (6996us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789601400.834525:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789601400.834607:0:9827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23fd180 x1876532918271104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.834639:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9827:1876532918271104:0@lo:5: 00000004:00080000:3.0:1789601400.834656:0:9827:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789601400.834703:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9827:1876532918271232:0@lo:900: 00000100:00100000:3.0:1789601400.834749:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.834782:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c220ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.835186:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9831:x1876532918270592:12345-0@lo:5: Request processed in 16882us (18072us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789601400.835194:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789601400.835295:0:9831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a38a80 x1876532918270592/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.835305:0:9831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789601400.835310:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918270592:0@lo:5: 00000004:00080000:3.0:1789601400.835320:0:9831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789601400.835351:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918271360:0@lo:700: 00000100:00100000:3.0:1789601400.835387:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601400.835464:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601400.835533:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271232 00000100:00100000:0.0:1789601400.835540:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271232 00000100:00100000:0.0:1789601400.835615:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601400.835634:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9827:x1876532918271232:12345-0@lo:900: 00000100:00100000:0.0:1789601400.835685:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9827:x1876532918271232:12345-0@lo:900: Request processed in 53us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601400.835691:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789601400.836212:0:9827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23fc700 x1876532918271232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601400.836224:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9827:1876532918271232:0@lo:900: 00000100:00100000:1.0:1789601400.840138:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271360 00000100:00100000:1.0:1789601400.840155:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271360 00000100:00100000:1.0:1789601400.840231:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601400.840243:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9831:x1876532918271360:12345-0@lo:700: 00000001:00080000:0.0:1789601400.849216:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789601400.855034:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9831:x1876532918271360:12345-0@lo:700: Request processed in 14787us (19639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601400.855048:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789601400.855198:0:9831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a38a80 x1876532918271360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601400.855214:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918271360:0@lo:700: 00000004:02000040:0.0:1789601400.859212:0:9831:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789601400.870004:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918271488:0@lo:5: 00000100:00100000:0.0:1789601400.870074:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601400.870123:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601400.870331:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271488 00000100:00100000:1.0:1789601400.870341:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271488 00000100:00100000:1.0:1789601400.870403:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601400.870414:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9831:x1876532918271488:12345-0@lo:5: 00002000:00080000:1.0:1789601400.882887:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789601400.882908:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789601400.889272:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9831:x1876532918271488:12345-0@lo:5: Request processed in 18854us (19192us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789601400.889285:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789601400.895828:0:9831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2264a80 x1876532918271488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601400.895850:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9831:1876532918271488:0@lo:5: 00000004:00080000:1.0:1789601400.895869:0:9831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1789601401.480683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601401.903531:0:9889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789601402.190208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918271616:0@lo:41: 00000100:00100000:0.0:1789601402.190283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601402.190359:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271616 00000100:00100000:0.0:1789601402.190369:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271616 00000100:00100000:0.0:1789601402.190419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601402.190429:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918271616:12345-0@lo:41: 00000004:00000024:0.0:1789601402.190476:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601402.190525:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918271616:12345-0@lo:41: Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601402.190532:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601402.190609:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918271616:0@lo:41: 00010000:00010000:1.0:1789601402.501782:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601402.695746:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918271744:0@lo:41: 00000100:00100000:0.0:1789601402.695820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601402.696389:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271744 00000100:00100000:1.0:1789601402.696401:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271744 00000100:00100000:1.0:1789601402.696465:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789601402.696476:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918271744:12345-0@lo:41: 00000004:00000024:1.0:1789601402.696513:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789601402.696618:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918271744:12345-0@lo:41: Request processed in 143us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601402.696625:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601402.696764:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918271744:0@lo:41: 00000020:00000004:0.0:1789601402.920935:0:9941:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601402.921130:0:9941:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789601403.526354:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789601403.831843:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1789601404.549927:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601404.744274:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918271872:0@lo:13: 00000100:00100000:1.0:1789601404.744366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601404.744582:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918271872 00000100:00100000:3.0:1789601404.744603:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918271872 00000100:00100000:3.0:1789601404.744670:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601404.744682:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918271872:12345-0@lo:13: 00002000:00000024:3.0:1789601404.744714:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601404.744765:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918271872:12345-0@lo:13: Request processed in 85us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601404.744773:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789601404.745164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601404.745200:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3426a00 x1876532918271872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601404.745221:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918271872:0@lo:13: 00000100:00100000:0.0:1789601404.745483:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918272000:0@lo:13: 00000100:00100000:0.0:1789601404.745522:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601404.745684:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272000 00000100:00100000:3.0:1789601404.745699:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272000 00000100:00100000:3.0:1789601404.745749:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601404.745756:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918272000:12345-0@lo:13: 00002000:00000024:3.0:1789601404.745770:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601404.745805:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918272000:12345-0@lo:13: Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601404.745811:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789601404.746051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601404.746075:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6a00 x1876532918272000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601404.746090:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918272000:0@lo:13: 00010000:00010000:1.0:1789601405.581527:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789601405.742476:0:10042:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601405.745880:0:10042:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789601406.277881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918272128:0@lo:13: 00000100:00100000:0.0:1789601406.277958:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.278161:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272128 00000100:00100000:3.0:1789601406.278171:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272128 00000100:00100000:3.0:1789601406.278235:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601406.278246:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918272128:12345-0@lo:13: 00002000:00000024:3.0:1789601406.278276:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601406.278326:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918272128:12345-0@lo:13: Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.278333:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789601406.278387:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601406.278439:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3425500 x1876532918272128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.278451:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789601406.278474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918272128:0@lo:13: 00000100:00100000:2.0:1789601406.278836:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918272384:0@lo:400: 00000100:00100000:2.0:1789601406.278872:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.278896:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918272896:0@lo:400: 00000100:00100000:2.0:1789601406.278916:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.278947:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918273408:0@lo:400: 00000100:00100000:2.0:1789601406.278972:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.278997:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789601406.279003:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918272512:0@lo:400: 00000100:00100000:2.0:1789601406.279043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.279061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918273024:0@lo:400: 00000100:00100000:2.0:1789601406.279080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.279096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918273536:0@lo:400: 00000100:00100000:2.0:1789601406.279119:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601406.279140:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272384 00000100:00100000:2.0:1789601406.279145:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272384 00000100:00100000:2.0:1789601406.279173:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272896 00000100:00100000:2.0:1789601406.279176:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272896 00000100:00100000:2.0:1789601406.279195:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273408 00000100:00100000:2.0:1789601406.279197:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273408 00000100:00100000:2.0:1789601406.279208:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273024 00000100:00100000:2.0:1789601406.279211:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273024 00000100:00100000:2.0:1789601406.279220:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273536 00000100:00100000:2.0:1789601406.279229:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273536 00000100:00100000:2.0:1789601406.279249:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601406.279255:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918272384:12345-0@lo:400: 00000100:00100000:2.0:1789601406.279295:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918272384:12345-0@lo:400: Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601406.279302:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601406.279317:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601406.279323:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918272896:12345-0@lo:400: 00000100:00100000:2.0:1789601406.279350:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918272896:12345-0@lo:400: Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601406.279355:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601406.279367:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601406.279372:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918273408:12345-0@lo:400: 00000100:00100000:2.0:1789601406.279397:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918273408:12345-0@lo:400: Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.279765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918272256:0@lo:400: 00000100:00100000:3.0:1789601406.279812:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.279836:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918272768:0@lo:400: 00000100:00100000:3.0:1789601406.279860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.279876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918273280:0@lo:400: 00000100:00100000:3.0:1789601406.279897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.279916:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789601406.279932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918272640:0@lo:400: 00000100:00100000:3.0:1789601406.279954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.279964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273152:0@lo:400: 00000100:00100000:3.0:1789601406.279982:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.280005:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273664:0@lo:400: 00000100:00100000:3.0:1789601406.280025:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.280050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272256 00000100:00100000:3.0:1789601406.280055:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272256 00000100:00100000:3.0:1789601406.280083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789601406.280090:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918272256:12345-0@lo:400: 00000100:00100000:3.0:1789601406.280125:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918272256:12345-0@lo:400: Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.280131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789601406.280161:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273280 00000100:00100000:3.0:1789601406.280164:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273280 00000100:00100000:3.0:1789601406.280184:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273152 00000100:00100000:3.0:1789601406.280187:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273152 00000100:00100000:3.0:1789601406.280197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273664 00000100:00100000:3.0:1789601406.280200:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273664 00000100:00100000:3.0:1789601406.280213:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601406.280220:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918273280:12345-0@lo:400: 00000100:00100000:3.0:1789601406.280251:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918273280:12345-0@lo:400: Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.280257:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601406.280268:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601406.280274:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273152:12345-0@lo:400: 00000100:00100000:3.0:1789601406.280299:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273152:12345-0@lo:400: Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.280304:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601406.280314:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601406.280319:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273664:12345-0@lo:400: 00000100:00100000:3.0:1789601406.280343:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273664:12345-0@lo:400: Request processed in 23us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.280355:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789601406.280388:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0b9c00 x1876532918273152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601406.280422:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273152:0@lo:400: 00010000:00080000:3.0:1789601406.280435:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6a00 x1876532918273664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601406.280442:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789601406.280454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273664:0@lo:400: 00000100:00100000:3.0:1789601406.280462:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918272256:0@lo:400: 00010000:00080000:3.0:1789601406.280470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6300 x1876532918273280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601406.280478:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918273280:0@lo:400: 00000100:00100000:0.0:1789601406.280675:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272512 00000100:00100000:0.0:1789601406.280682:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272512 00000100:00100000:0.0:1789601406.280716:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272768 00000100:00100000:0.0:1789601406.280719:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272768 00000100:00100000:0.0:1789601406.280732:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601406.280738:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918272512:12345-0@lo:400: 00000100:00100000:0.0:1789601406.280777:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918272512:12345-0@lo:400: Request processed in 39us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.280788:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601406.280801:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601406.280807:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918272768:12345-0@lo:400: 00000100:00100000:0.0:1789601406.280840:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918272768:12345-0@lo:400: Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.280844:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789601406.280870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601406.280874:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601406.280876:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601406.280878:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601406.280894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918272768:0@lo:400: 00000100:00100000:0.0:1789601406.280941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918272640 00000100:00100000:0.0:1789601406.280946:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918272640 00000100:00100000:0.0:1789601406.280965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601406.280972:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918273024:12345-0@lo:400: 00000100:00100000:0.0:1789601406.281003:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918273024:12345-0@lo:400: Request processed in 32us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.281009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601406.281022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601406.281028:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918273536:12345-0@lo:400: 00000100:00100000:0.0:1789601406.281056:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918273536:12345-0@lo:400: Request processed in 28us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.281061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601406.281073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601406.281079:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918272640:12345-0@lo:400: 00000100:00100000:0.0:1789601406.281108:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918272640:12345-0@lo:400: Request processed in 30us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.281123:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789601406.281151:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6300 x1876532918272640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918272640:0@lo:400: 00000100:00100000:0.0:1789601406.281203:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918272512:0@lo:400: 00010000:00080000:0.0:1789601406.281214:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c5180 x1876532918273024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281222:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918273024:0@lo:400: 00010000:00080000:0.0:1789601406.281231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a4380 x1876532918273536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918273536:0@lo:400: 00010000:00080000:0.0:1789601406.281250:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c7100 x1876532918272384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281257:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918272384:0@lo:400: 00010000:00080000:0.0:1789601406.281268:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c4380 x1876532918272896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281275:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918272896:0@lo:400: 00010000:00080000:0.0:1789601406.281288:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a5c00 x1876532918273408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.281296:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918273408:0@lo:400: 00000100:00100000:2.0:1789601406.281742:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789601406.283219:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273792:0@lo:13: 00000100:00100000:0.0:1789601406.283315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.283753:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273792 00000100:00100000:3.0:1789601406.283762:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273792 00000100:00100000:3.0:1789601406.283820:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601406.283830:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273792:12345-0@lo:13: 00002000:00000024:3.0:1789601406.283853:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601406.283911:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918273792:12345-0@lo:13: Request processed in 83us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.283918:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789601406.284530:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3425f80 x1876532918273792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601406.284550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918273792:0@lo:13: 00010000:00010000:1.0:1789601406.602778:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601406.930828:0:10091:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601406.930838:0:10091:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789601407.301781:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601407.301810:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918273920:0@lo:41: 00000100:00100000:3.0:1789601407.301887:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601407.302099:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918273920 00000100:00100000:1.0:1789601407.302109:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918273920 00000100:00100000:1.0:1789601407.302165:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789601407.302175:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918273920:12345-0@lo:41: 00000004:00000024:1.0:1789601407.302208:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601407.302312:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918273920:12345-0@lo:41: Request processed in 139us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601407.302320:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601407.303795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918273920:0@lo:41: 00000100:00100000:0.0:1789601407.582336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601407.582517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300032 00000100:00100000:3.0:1789601407.582541:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300032 00000100:00100000:3.0:1789601407.582610:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:3.0:1789601407.582619:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2414:x1876532898300032:12345-192.168.203.48@tcp:250: 00010000:00080000:3.0:1789601407.582666:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 26752b1e-2ce1-4365-8a20-41d46cc3fa32@192.168.203.48@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:3.0:1789601407.582695:0:6516:0:(genops.c:1384:class_connect()) connect: client 26752b1e-2ce1-4365-8a20-41d46cc3fa32, cookie 0x74872e3eca9f1502 00000100:00080000:3.0:1789601407.582826:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8df3c2ad8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601407.582910:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+5:2414:x1876532898300032:12345-192.168.203.48@tcp:250: Request processed in 291us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601407.582918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:0.0:1789601407.612819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.614842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300160 00000100:00100000:2.0:1789601407.614859:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300160 00000100:00100000:2.0:1789601407.614960:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:2.0:1789601407.614973:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+5:6175:x1876532898300160:12345-192.168.203.48@tcp:101: 00010000:00010000:2.0:1789601407.614990:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601407.615008:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48961 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.615041:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.615054:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.615077:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383c00, rc 0) 00000100:00100000:2.0:1789601407.615152:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+6:6175:x1876532898300160:12345-192.168.203.48@tcp:101: Request processed in 181us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.615159:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1789601407.617595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.617847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300288 00000100:00100000:0.0:1789601407.617858:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300288 00000100:00100000:0.0:1789601407.618185:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 183 00000100:00100000:0.0:1789601407.618197:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+6:6175:x1876532898300288:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1789601407.618394:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+6:6175:x1876532898300288:12345-192.168.203.48@tcp:501: Request processed in 199us (807us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601407.618412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 183 00010000:00010000:2.0:1789601407.624439:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601407.629824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601407.629910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300416 00000100:00100000:3.0:1789601407.629938:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300416 00000100:00100000:3.0:1789601407.630000:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:3.0:1789601407.630010:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+6:6175:x1876532898300416:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789601407.630028:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601407.630045:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48968 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.630076:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.630087:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.630098:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363400, rc 0) 00000100:00100000:3.0:1789601407.630159:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+7:6175:x1876532898300416:12345-192.168.203.48@tcp:101: Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601407.630166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:1.0:1789601407.633194:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.633723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300544 00000100:00100000:2.0:1789601407.633735:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300544 00000100:00100000:2.0:1789601407.633798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:2.0:1789601407.633809:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+7:6175:x1876532898300544:12345-192.168.203.48@tcp:501: 00000100:00100000:2.0:1789601407.633971:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6175:x1876532898300544:12345-192.168.203.48@tcp:501: Request processed in 163us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.633979:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:1.0:1789601407.642868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.643093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300672 00000100:00100000:0.0:1789601407.643107:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300672 00000100:00100000:0.0:1789601407.643172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:0.0:1789601407.643183:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6175:x1876532898300672:12345-192.168.203.48@tcp:503: 00000100:00100000:0.0:1789601407.643347:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6175:x1876532898300672:12345-192.168.203.48@tcp:503: Request processed in 164us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.643355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:1.0:1789601407.659197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.659551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300800 00000100:00100000:0.0:1789601407.659605:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300800 00000100:00100000:0.0:1789601407.659679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:0.0:1789601407.659690:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6193:x1876532898300800:12345-192.168.203.48@tcp:502: 00000100:00100000:0.0:1789601407.659840:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6193:x1876532898300800:12345-192.168.203.48@tcp:502: Request processed in 150us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.659847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:1.0:1789601407.722351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.722461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898300928 00000100:00100000:2.0:1789601407.722473:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898300928 00000100:00100000:2.0:1789601407.722537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:2.0:1789601407.722547:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6193:x1876532898300928:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1789601407.722742:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6193:x1876532898300928:12345-192.168.203.48@tcp:502: Request processed in 196us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.722750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:1.0:1789601407.732416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601407.732590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301056 00000100:00100000:3.0:1789601407.732602:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301056 00000100:00100000:3.0:1789601407.732667:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:3.0:1789601407.732678:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6175:x1876532898301056:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789601407.732696:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601407.732715:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363600/0x74872e3eca9f1517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48999 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.732746:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363600/0x74872e3eca9f1517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48999 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.732758:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363600/0x74872e3eca9f1517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48999 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601407.732767:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363600, rc 0) 00000100:00100000:3.0:1789601407.732828:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6175:x1876532898301056:12345-192.168.203.48@tcp:101: Request processed in 152us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601407.732835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:1.0:1789601407.746295:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.746591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301184 00000100:00100000:0.0:1789601407.746604:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301184 00000100:00100000:0.0:1789601407.746665:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:0.0:1789601407.746677:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6175:x1876532898301184:12345-192.168.203.48@tcp:256: 20000000:01000000:0.0:1789601407.746706:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789601407.746730:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789601407.746734:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789601407.746737:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789601407.746739:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789601407.746741:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789601407.749750:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6175:x1876532898301184:12345-192.168.203.48@tcp:256: Request processed in 3066us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.749765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:1.0:1789601407.763781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.764185:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301312 00000100:00100000:2.0:1789601407.764197:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301312 00000100:00100000:2.0:1789601407.764271:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:2.0:1789601407.764281:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6175:x1876532898301312:12345-192.168.203.48@tcp:101: 00010000:00010000:2.0:1789601407.764298:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601407.764330:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.764362:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.764374:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601407.764384:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601407.764454:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6175:x1876532898301312:12345-192.168.203.48@tcp:101: Request processed in 175us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.764462:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:1.0:1789601407.767330:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.767426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301440 00000100:00100000:0.0:1789601407.767437:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301440 00000100:00100000:0.0:1789601407.767504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:0.0:1789601407.767514:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6175:x1876532898301440:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1789601407.767695:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6175:x1876532898301440:12345-192.168.203.48@tcp:501: Request processed in 182us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.767703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:1.0:1789601407.772307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601407.772386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301568 00000100:00100000:3.0:1789601407.772397:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301568 00000100:00100000:3.0:1789601407.772465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:3.0:1789601407.772481:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6175:x1876532898301568:12345-192.168.203.48@tcp:503: 00000100:00100000:3.0:1789601407.772651:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6175:x1876532898301568:12345-192.168.203.48@tcp:503: Request processed in 170us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601407.772659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:1.0:1789601407.781756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.781873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301696 00000100:00100000:2.0:1789601407.781886:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301696 00000100:00100000:2.0:1789601407.781956:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:2.0:1789601407.781968:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6198:x1876532898301696:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1789601407.782106:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6198:x1876532898301696:12345-192.168.203.48@tcp:502: Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.782114:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:1.0:1789601407.785344:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601407.785441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301824 00000100:00100000:0.0:1789601407.785452:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301824 00000100:00100000:0.0:1789601407.785510:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:0.0:1789601407.785519:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6198:x1876532898301824:12345-192.168.203.48@tcp:502: 00000100:00100000:0.0:1789601407.785701:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6198:x1876532898301824:12345-192.168.203.48@tcp:502: Request processed in 182us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.785708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:1.0:1789601407.801765:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601407.801810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601407.804973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898301952 00000100:00100000:2.0:1789601407.804989:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898301952 00000100:00100000:2.0:1789601407.805046:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302208 00000100:00100000:2.0:1789601407.805050:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302208 00000100:00100000:2.0:1789601407.805087:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601407.805097:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2414:x1876532898301952:12345-192.168.203.48@tcp:38: 00010000:00080000:2.0:1789601407.805130:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1789601407.805181:0:6523:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f1525 00000004:00100000:2.0:1789601407.805217:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789601407.805413:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789601407.805420:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2414:x1876532898302208:12345-192.168.203.48@tcp:38: 00010000:00080000:3.0:1789601407.805447:0:9040:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:3.0:1789601407.805475:0:9040:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f152c 00000004:00100000:3.0:1789601407.805487:0:9040:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789601407.805737:0:9040:0:(import.c:65:import_set_state_nolock()) ffff8df3c2add800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601407.805814:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898302208:12345-192.168.203.48@tcp:38: Request processed in 391us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601407.805821:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00080000:2.0:1789601407.806879:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8df3c2af9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601407.807393:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898301952:12345-192.168.203.48@tcp:38: Request processed in 2294us (5635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.807412:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789601407.814787:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918274048:0@lo:41: 00000100:00100000:0.0:1789601407.815064:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601407.815309:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274048 00000100:00100000:2.0:1789601407.815319:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274048 00000100:00100000:2.0:1789601407.815380:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789601407.815390:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918274048:12345-0@lo:41: 00000004:00000024:2.0:1789601407.815434:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789601407.815498:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918274048:12345-0@lo:41: Request processed in 109us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601407.815505:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601407.815847:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918274048:0@lo:41: 00010000:00010000:1.0:1789601408.646403:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601408.820022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601408.820188:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302336 00000100:00100000:3.0:1789601408.820201:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302336 00000100:00100000:3.0:1789601408.820279:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1789601408.820289:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898302336:12345-192.168.203.48@tcp:41: 00000004:00000024:3.0:1789601408.820327:0:9040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1789601408.820411:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601408.820418:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898302336:12345-192.168.203.48@tcp:41: Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601408.820426:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789601408.821181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601408.821245:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302464 00000100:00100000:0.0:1789601408.821258:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302464 00000100:00100000:0.0:1789601408.821311:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1789601408.821320:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898302464:12345-192.168.203.48@tcp:41: 00000004:00000024:0.0:1789601408.821341:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789601408.821378:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898302464:12345-192.168.203.48@tcp:41: Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601408.821385:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00080000:1.0:1789601408.821618:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601408.823132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601408.823617:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302080 00000100:00100000:3.0:1789601408.823627:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302080 00000100:00100000:3.0:1789601408.823721:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601408.823732:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898302080:12345-192.168.203.48@tcp:41: 00000004:00000024:3.0:1789601408.823760:0:9040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789601408.823821:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898302080:12345-192.168.203.48@tcp:41: Request processed in 92us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601408.823826:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789601408.824598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601408.824694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302592 00000100:00100000:0.0:1789601408.824701:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302592 00000100:00100000:0.0:1789601408.824812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789601408.824822:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898302592:12345-192.168.203.48@tcp:40: 00000100:00100000:0.0:1789601408.824881:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898302592:12345-192.168.203.48@tcp:40: Request processed in 61us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601408.824888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789601408.826937:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601408.827049:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601408.827529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302848 00000100:00100000:1.0:1789601408.827539:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302848 00000100:00100000:1.0:1789601408.827769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:1.0:1789601408.827781:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898302848:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789601408.827857:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898302848:12345-192.168.203.48@tcp:400: Request processed in 79us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601408.827865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:3.0:1789601408.828638:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302720 00000100:00100000:3.0:1789601408.828646:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302720 00000100:00100000:3.0:1789601408.828683:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789601408.828701:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2414:x1876532898302720:12345-192.168.203.48@tcp:8: 00010000:00080000:3.0:1789601408.828729:0:8441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1789601408.828756:0:8441:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f1533 00002000:00100000:3.0:1789601408.828766:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af09a131-8cce-462c-8c01-5d48daa688cf/ffff8df3c19ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789601408.828783:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789601408.828922:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601408.828962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601408.829006:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898302976 00000100:00100000:2.0:1789601408.829015:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898302976 00000100:00100000:2.0:1789601408.829045:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789601408.829051:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2414:x1876532898302976:12345-192.168.203.48@tcp:8: 00002000:00080000:3.0:1789601408.829058:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:2.0:1789601408.829068:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1789601408.829089:0:8439:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f153a 00000100:00080000:3.0:1789601408.829092:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cb800 : changing import state from RECOVER to FULL 00002000:00100000:2.0:1789601408.829094:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af09a131-8cce-462c-8c01-5d48daa688cf/ffff8df3c2af9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789601408.829104:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789601408.829157:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898302720:12345-192.168.203.48@tcp:8: Request processed in 436us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601408.829164:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789601408.829186:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303104 00000100:00100000:3.0:1789601408.829190:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303104 00000100:00100000:3.0:1789601408.829216:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789601408.829222:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898303104:12345-192.168.203.48@tcp:900: 00000100:00100000:3.0:1789601408.829254:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898303104:12345-192.168.203.48@tcp:900: Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601408.829261:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00002000:00080000:2.0:1789601408.829533:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789601408.829552:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601408.829598:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898302976:12345-192.168.203.48@tcp:8: Request processed in 545us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601408.829613:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789601408.832658:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601408.832874:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303232 00000100:00100000:3.0:1789601408.832885:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303232 00000100:00100000:3.0:1789601408.833736:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789601408.833752:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898303232:12345-192.168.203.48@tcp:33: 00000004:00080000:3.0:1789601408.852254:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18392us 00000004:00200000:3.0:1789601408.863647:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789601408.863764:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:6175:x1876532898303232:12345-192.168.203.48@tcp:33: Request processed in 30013us (31109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601408.863784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789601409.113922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601409.114044:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303360 00000100:00100000:1.0:1789601409.114055:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303360 00000100:00100000:1.0:1789601409.114121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789601409.114132:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:6216:x1876532898303360:12345-192.168.203.48@tcp:101: 00010000:00010000:1.0:1789601409.114163:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601409.114229:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef200/0x74872e3eca9f1541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114307:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114333:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114348:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601409.114405:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789601409.114409:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601409.114425:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114450:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef200/0x74872e3eca9f1541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d1 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114467:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d1 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601409.114486:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9d00) 00010000:00010000:1.0:1789601409.114489:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601409.114493:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:1.0:1789601409.114867:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:6216:x1876532898303360:12345-192.168.203.48@tcp:101: Request processed in 735us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601409.114875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00010000:00010000:1.0:1789601409.669869:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601409.862487:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918274176:0@lo:13: 00000100:00100000:1.0:1789601409.862579:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601409.865651:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918274304:0@lo:13: 00000100:00100000:0.0:1789601409.865737:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601409.865798:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274176 00000100:00100000:2.0:1789601409.865808:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274176 00000100:00100000:2.0:1789601409.865870:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274304 00000100:00100000:2.0:1789601409.865873:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274304 00000100:00100000:2.0:1789601409.865892:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601409.865912:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918274176:12345-0@lo:13: 00002000:00000024:2.0:1789601409.865936:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601409.865983:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918274176:12345-0@lo:13: Request processed in 82us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601409.865990:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601409.866009:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601409.866015:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918274304:12345-0@lo:13: 00002000:00000024:2.0:1789601409.866025:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601409.866051:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918274304:12345-0@lo:13: Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601409.866056:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789601409.867005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601409.867048:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a7800 x1876532918274304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601409.867069:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918274304:0@lo:13: 00010000:00080000:1.0:1789601409.867360:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3425880 x1876532918274176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601409.867404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918274176:0@lo:13: 00010000:00010000:2.0:1789601410.693871:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601411.398237:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918274432:0@lo:13: 00000100:00100000:1.0:1789601411.398328:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601411.398436:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601411.398445:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918274560:0@lo:13: 00000100:00100000:1.0:1789601411.398480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601411.398692:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274432 00000100:00100000:0.0:1789601411.398702:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274432 00000100:00100000:0.0:1789601411.398764:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274560 00000100:00100000:0.0:1789601411.398767:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274560 00000100:00100000:0.0:1789601411.398790:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601411.398800:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918274432:12345-0@lo:13: 00002000:00000024:0.0:1789601411.398834:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601411.399169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918274816:0@lo:400: 00000100:00100000:3.0:1789601411.399291:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918275072:0@lo:400: 00000100:00080000:1.0:1789601411.399386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601411.399402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918274688:0@lo:400: 00000100:00100000:2.0:1789601411.404548:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.404631:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918275328:0@lo:400: 00000100:00100000:2.0:1789601411.404693:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.404962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918275840:0@lo:400: 00000100:00100000:2.0:1789601411.404987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.405063:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274816 00000100:00100000:2.0:1789601411.405090:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274816 00000100:00100000:2.0:1789601411.405143:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275328 00000100:00100000:2.0:1789601411.405146:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275328 00000100:00100000:2.0:1789601411.405174:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275840 00000100:00100000:2.0:1789601411.405177:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275840 00000100:00100000:2.0:1789601411.405194:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601411.405203:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918274816:12345-0@lo:400: 00000100:00100000:2.0:1789601411.405645:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918274816:12345-0@lo:400: Request processed in 441us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.405653:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601411.405675:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601411.405682:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918275328:12345-0@lo:400: 00000100:00100000:2.0:1789601411.405883:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918275328:12345-0@lo:400: Request processed in 200us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.405890:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601411.405904:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789601411.405911:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918275840:12345-0@lo:400: 00000100:00100000:2.0:1789601411.405939:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918275840:12345-0@lo:400: Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.405945:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789601411.405971:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918274944:0@lo:400: 00000100:00100000:2.0:1789601411.406001:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.406024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918275456:0@lo:400: 00000100:00100000:2.0:1789601411.406045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.406062:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918275968:0@lo:400: 00000100:00100000:2.0:1789601411.406080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601411.406843:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274944 00000100:00100000:2.0:1789601411.406862:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274944 00000100:00100000:2.0:1789601411.406903:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789601411.406910:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918274944:12345-0@lo:400: 00000100:00100000:2.0:1789601411.406959:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918274944:12345-0@lo:400: Request processed in 50us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.406966:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789601411.406992:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275456 00000100:00100000:2.0:1789601411.406996:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275456 00000100:00100000:2.0:1789601411.407013:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275968 00000100:00100000:2.0:1789601411.407016:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275968 00000100:00100000:2.0:1789601411.407028:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789601411.407033:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918275456:12345-0@lo:400: 00000100:00100000:2.0:1789601411.407063:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918275456:12345-0@lo:400: Request processed in 29us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.407068:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789601411.407079:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789601411.407085:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918275968:12345-0@lo:400: 00000100:00100000:2.0:1789601411.407126:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918275968:12345-0@lo:400: Request processed in 40us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.407132:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789601411.407169:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918274944:0@lo:400: 00010000:00080000:2.0:1789601411.407183:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a5c00 x1876532918275456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601411.407193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918275456:0@lo:400: 00010000:00080000:2.0:1789601411.407202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff503100 x1876532918275968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601411.407222:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918275968:0@lo:400: 00000100:00100000:2.0:1789601411.407279:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918274816:0@lo:400: 00000100:00100000:2.0:1789601411.407291:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918275328:0@lo:400: 00000100:00100000:2.0:1789601411.407302:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918275840:0@lo:400: 00000100:00080000:2.0:1789601411.407371:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601411.407385:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601411.407783:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601411.407837:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918275584:0@lo:400: 00000100:00100000:3.0:1789601411.407885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601411.408552:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275584 00000100:00100000:3.0:1789601411.408589:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275584 00000100:00100000:3.0:1789601411.408669:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789601411.408681:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918275584:12345-0@lo:400: 00000100:00100000:3.0:1789601411.408744:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918275584:12345-0@lo:400: Request processed in 66us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601411.408750:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789601411.408780:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601411.408807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a4380 x1876532918275584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601411.408822:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918275584:0@lo:400: 00000100:00100000:2.0:1789601411.409765:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275072 00000100:00100000:2.0:1789601411.409775:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275072 00000100:00100000:2.0:1789601411.409836:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789601411.409845:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918275072:12345-0@lo:400: 00000100:00100000:2.0:1789601411.409935:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918275072:12345-0@lo:400: Request processed in 91us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601411.409948:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601411.416772:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918275072:0@lo:400: 00000100:00100000:0.0:1789601411.418814:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918274432:12345-0@lo:13: Request processed in 20004us (20475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601411.418832:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601411.419262:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601411.419282:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918274560:12345-0@lo:13: 00002000:00000024:0.0:1789601411.419316:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601411.419386:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918274560:12345-0@lo:13: Request processed in 104us (20893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601411.419393:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601411.419760:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601411.419828:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918275200:0@lo:400: 00000100:00100000:1.0:1789601411.419915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601411.420201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918274688 00000100:00100000:3.0:1789601411.420212:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918274688 00000100:00100000:3.0:1789601411.420261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789601411.420269:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918274688:12345-0@lo:400: 00000100:00100000:3.0:1789601411.420314:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918274688:12345-0@lo:400: Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601411.420320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789601411.421693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918275712:0@lo:400: 00000100:00100000:1.0:1789601411.421751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601411.421787:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275712 00000100:00100000:1.0:1789601411.421794:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275712 00000100:00100000:1.0:1789601411.421858:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789601411.422438:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3427800 x1876532918274560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601411.422477:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918274560:0@lo:13: 00010000:00080000:2.0:1789601411.422523:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f74ca680 x1876532918274432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601411.422538:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918274432:0@lo:13: 00000100:00100000:3.0:1789601411.422745:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918275200 00000100:00100000:3.0:1789601411.422761:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918275200 00000100:00100000:3.0:1789601411.422806:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789601411.422817:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918275200:12345-0@lo:400: 00000100:00080000:2.0:1789601411.423289:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601411.423592:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918275200:12345-0@lo:400: Request processed in 776us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601411.423602:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789601411.423774:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918275712:12345-0@lo:400: 00000100:00100000:1.0:1789601411.423826:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918275712:12345-0@lo:400: Request processed in 62us (2075us total) trans 0 rc 0/0 00010000:00080000:0.0:1789601411.429686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6300 x1876532918275712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601411.429709:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918275712:0@lo:400: 00000100:00100000:1.0:1789601411.429792:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601411.430161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918274688:0@lo:400: 00000100:00100000:0.0:1789601411.430195:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918275200:0@lo:400: 00010000:00010000:1.0:1789601411.720190:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601412.209176:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601412.209285:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303488 00000100:00100000:3.0:1789601412.209308:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303488 00000100:00100000:3.0:1789601412.209404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1789601412.209416:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:6268:x1876532898303488:12345-192.168.203.48@tcp:41: 00000004:00000024:3.0:1789601412.209464:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1789601412.209652:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601412.209812:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:6268:x1876532898303488:12345-192.168.203.48@tcp:41: Request processed in 398us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601412.210146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789601412.219048:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601412.219217:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303616 00000100:00100000:0.0:1789601412.219228:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303616 00000100:00100000:0.0:1789601412.219321:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789601412.219335:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303616:12345-192.168.203.48@tcp:41: 00000004:00000024:0.0:1789601412.219392:0:9040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601412.219473:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303616:12345-192.168.203.48@tcp:41: Request processed in 142us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601412.219481:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00080000:2.0:1789601412.220158:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601412.230735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601412.230840:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303744 00000100:00100000:2.0:1789601412.230851:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303744 00000100:00100000:2.0:1789601412.230947:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789601412.230960:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303744:12345-192.168.203.48@tcp:13: 00002000:00000024:2.0:1789601412.231001:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601412.231081:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303744:12345-192.168.203.48@tcp:13: Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601412.231089:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00080000:0.0:1789601412.231490:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601412.236831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601412.238251:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898303872 00000100:00100000:2.0:1789601412.238267:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898303872 00000100:00100000:2.0:1789601412.238723:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1789601412.238736:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303872:12345-192.168.203.48@tcp:13: 00002000:00000024:2.0:1789601412.238770:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789601412.238783:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601412.238868:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af09a131-8cce-462c-8c01-5d48daa688cf+6:6268:x1876532898303872:12345-192.168.203.48@tcp:13: Request processed in 135us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601412.238877:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601412.421764:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918276096:0@lo:41: 00000100:00100000:3.0:1789601412.421866:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601412.422186:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276096 00000100:00100000:0.0:1789601412.422196:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276096 00000100:00100000:0.0:1789601412.422261:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789601412.422272:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918276096:12345-0@lo:41: 00000004:00000024:0.0:1789601412.422304:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601412.422366:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918276096:12345-0@lo:41: Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601412.422383:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789601412.422468:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918276096:0@lo:41: 00010000:00010000:1.0:1789601412.742337:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601412.939616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918276224:0@lo:41: 00000100:00100000:1.0:1789601412.939709:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1789601412.939801:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000100:00100000:0.0:1789601412.940282:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276224 00000100:00100000:0.0:1789601412.940292:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276224 00000100:00100000:0.0:1789601412.940354:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789601412.941076:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918276224:12345-0@lo:41: 00000004:00000024:0.0:1789601412.941132:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789601412.941275:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918276224:12345-0@lo:41: Request processed in 911us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601412.941290:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789601412.941432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918276224:0@lo:41: 00010000:00010000:2.0:1789601413.766079:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601413.922461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601413.922510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601413.922544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601413.922597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601413.922624:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601413.922752:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304256 00000100:00100000:3.0:1789601413.922764:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304256 00000100:00100000:3.0:1789601413.922830:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304128 00000100:00100000:3.0:1789601413.922833:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304128 00000100:00100000:3.0:1789601413.922857:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789601413.922869:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898304256:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789601413.922974:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898304256:12345-192.168.203.48@tcp:400: Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601413.922981:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789601413.923001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789601413.923007:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898304128:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789601413.923051:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898304128:12345-192.168.203.48@tcp:400: Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601413.923057:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789601413.923076:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304512 00000100:00100000:3.0:1789601413.923079:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304512 00000100:00100000:3.0:1789601413.923105:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304384 00000100:00100000:3.0:1789601413.923108:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304384 00000100:00100000:3.0:1789601413.923129:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601413.923135:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898304512:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789601413.923159:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898304512:12345-192.168.203.48@tcp:400: Request processed in 25us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601413.923164:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601413.923174:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601413.923179:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898304384:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789601413.923471:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898304384:12345-192.168.203.48@tcp:400: Request processed in 289us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601413.923478:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789601413.925338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304000 00000100:00100000:1.0:1789601413.925368:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304000 00000100:00100000:1.0:1789601413.925445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:1.0:1789601413.925455:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898304000:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789601413.925531:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898304000:12345-192.168.203.48@tcp:400: Request processed in 77us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601413.925539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 198 00000001:00100000:2.0:1789601413.969408:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000001:00100000:3.0:1789601413.970725:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00010000:00010000:1.0:1789601414.790080:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601414.983337:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918276352:0@lo:13: 00000100:00100000:2.0:1789601414.983445:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601414.983890:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276352 00000100:00100000:1.0:1789601414.983900:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276352 00000100:00100000:1.0:1789601414.983971:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601414.983993:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918276352:12345-0@lo:13: 00002000:00000024:1.0:1789601414.984028:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601414.984086:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918276352:12345-0@lo:13: Request processed in 97us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601414.984094:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789601414.984337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601414.984389:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73b1c00 x1876532918276352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601414.984411:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918276352:0@lo:13: 00000100:00100000:0.0:1789601414.986685:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00100000:1.0:1789601414.990055:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000100:00100000:0.0:1789601414.990844:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918276480:0@lo:13: 00000100:00100000:0.0:1789601414.990954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601414.991191:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276480 00000100:00100000:1.0:1789601414.991202:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276480 00000100:00100000:1.0:1789601414.991293:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601414.991303:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918276480:12345-0@lo:13: 00002000:00000024:1.0:1789601414.991331:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601414.991403:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918276480:12345-0@lo:13: Request processed in 102us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601414.991429:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789601414.991664:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601414.991756:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff500000 x1876532918276480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601414.991778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918276480:0@lo:13: 00010000:00010000:1.0:1789601415.818351:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601416.521419:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918276864:0@lo:400: 00000100:00100000:2.0:1789601416.521487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601416.521535:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918277376:0@lo:400: 00000100:00100000:2.0:1789601416.521573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601416.521590:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918277888:0@lo:400: 00000100:00100000:2.0:1789601416.521610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601416.521632:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789601416.521638:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918276736:0@lo:400: 00000100:00100000:2.0:1789601416.521658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601416.521673:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918277248:0@lo:400: 00000100:00100000:2.0:1789601416.521692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601416.521706:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918277760:0@lo:400: 00000100:00100000:2.0:1789601416.521724:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522248:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918276608:0@lo:400: 00000100:00100000:0.0:1789601416.522284:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918277120:0@lo:400: 00000100:00100000:0.0:1789601416.522327:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522356:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918277632:0@lo:400: 00000100:00100000:0.0:1789601416.522379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918278144:0@lo:400: 00000100:00100000:0.0:1789601416.522414:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522431:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789601416.522437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918276992:0@lo:400: 00000100:00100000:0.0:1789601416.522457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918277504:0@lo:400: 00000100:00100000:0.0:1789601416.522483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522506:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918278016:0@lo:400: 00000100:00100000:0.0:1789601416.522523:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918278272:0@lo:13: 00000100:00100000:0.0:1789601416.522583:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601416.522615:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277376 00000100:00100000:0.0:1789601416.522623:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277376 00000100:00100000:0.0:1789601416.522672:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277888 00000100:00100000:0.0:1789601416.522676:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277888 00000100:00100000:0.0:1789601416.522690:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276736 00000100:00100000:0.0:1789601416.522693:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276736 00000100:00100000:0.0:1789601416.522703:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277248 00000100:00100000:0.0:1789601416.522705:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277248 00000100:00100000:0.0:1789601416.522715:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277760 00000100:00100000:0.0:1789601416.522717:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277760 00000100:00100000:3.0:1789601416.522855:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276864 00000100:00100000:3.0:1789601416.522859:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276864 00000100:00100000:3.0:1789601416.522885:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277120 00000100:00100000:3.0:1789601416.522888:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277120 00000100:00100000:3.0:1789601416.522904:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601416.522913:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918276864:12345-0@lo:400: 00000100:00100000:3.0:1789601416.522974:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918276864:12345-0@lo:400: Request processed in 61us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.522992:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601416.523011:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601416.523016:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918277120:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523050:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918277120:12345-0@lo:400: Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523056:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601416.523073:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276992 00000100:00100000:3.0:1789601416.523076:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276992 00000100:00100000:3.0:1789601416.523092:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789601416.523098:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918277376:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523127:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918277376:12345-0@lo:400: Request processed in 29us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789601416.523145:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601416.523151:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918277888:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523177:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918277888:12345-0@lo:400: Request processed in 26us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601416.523191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601416.523195:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918276736:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523215:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918276736:12345-0@lo:400: Request processed in 20us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523219:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601416.523227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601416.523232:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918277248:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523263:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918277248:12345-0@lo:400: Request processed in 31us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601416.523278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601416.523283:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918276992:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523302:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918276992:12345-0@lo:400: Request processed in 20us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601416.523330:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277632 00000100:00100000:3.0:1789601416.523333:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277632 00000100:00100000:3.0:1789601416.523379:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278144 00000100:00100000:3.0:1789601416.523382:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278144 00000100:00100000:3.0:1789601416.523391:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918277504 00000100:00100000:3.0:1789601416.523393:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918277504 00000100:00100000:3.0:1789601416.523403:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278016 00000100:00100000:3.0:1789601416.523405:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278016 00000100:00100000:3.0:1789601416.523416:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601416.523421:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918277632:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523449:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918277632:12345-0@lo:400: Request processed in 28us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523454:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601416.523463:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601416.523468:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918278144:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523487:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918278144:12345-0@lo:400: Request processed in 20us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523492:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601416.523500:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601416.523505:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918277504:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523535:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918277504:12345-0@lo:400: Request processed in 29us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523540:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601416.523551:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601416.523582:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918278016:12345-0@lo:400: 00000100:00100000:3.0:1789601416.523609:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918278016:12345-0@lo:400: Request processed in 54us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523614:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601416.523644:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601416.523654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918278400:0@lo:13: 00000100:00100000:3.0:1789601416.523687:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601416.523716:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278272 00000100:00100000:3.0:1789601416.523720:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278272 00000100:00100000:3.0:1789601416.523749:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278400 00000100:00100000:3.0:1789601416.523752:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278400 00000100:00100000:3.0:1789601416.523764:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601416.523770:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918278272:12345-0@lo:13: 00002000:00000024:3.0:1789601416.523805:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601416.523840:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918278272:12345-0@lo:13: Request processed in 70us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523846:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601416.523858:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601416.523864:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918278400:12345-0@lo:13: 00002000:00000024:3.0:1789601416.523875:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601416.523897:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918278400:12345-0@lo:13: Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601416.523902:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789601416.523947:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3426d80 x1876532918278400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.523965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918278400:0@lo:13: 00010000:00080000:3.0:1789601416.523977:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f74cad80 x1876532918278272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.523986:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918278272:0@lo:13: 00000100:00100000:3.0:1789601416.524018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918276992:0@lo:400: 00010000:00080000:3.0:1789601416.524028:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff500000 x1876532918277504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.524036:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918277504:0@lo:400: 00010000:00080000:3.0:1789601416.524044:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6300 x1876532918278016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.524051:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918278016:0@lo:400: 00000100:00100000:3.0:1789601416.524060:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918277120:0@lo:400: 00010000:00080000:3.0:1789601416.524070:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff500e00 x1876532918277632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.524077:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918277632:0@lo:400: 00010000:00080000:3.0:1789601416.524085:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6d80 x1876532918278144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601416.524091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918278144:0@lo:400: 00000100:00100000:0.0:1789601416.525487:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789601416.525505:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918277760:12345-0@lo:400: 00000100:00100000:0.0:1789601416.525587:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918277760:12345-0@lo:400: Request processed in 90us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601416.525593:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789601416.525622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918276608 00000100:00100000:0.0:1789601416.525628:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918276608 00000100:00100000:0.0:1789601416.525658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789601416.525664:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918276608:12345-0@lo:400: 00000100:00100000:0.0:1789601416.525698:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918276608:12345-0@lo:400: Request processed in 34us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601416.525703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1789601416.525915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601416.525921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601416.525925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601416.525938:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601416.525979:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918276736:0@lo:400: 00000100:00100000:0.0:1789601416.525993:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918277248:0@lo:400: 00000100:00100000:0.0:1789601416.526003:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918277760:0@lo:400: 00000100:00100000:0.0:1789601416.526015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918276864:0@lo:400: 00010000:00080000:0.0:1789601416.526029:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff503b80 x1876532918277376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601416.526040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918277376:0@lo:400: 00010000:00080000:0.0:1789601416.526052:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a4e00 x1876532918277888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601416.526060:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918277888:0@lo:400: 00000100:00100000:3.0:1789601416.526174:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918276608:0@lo:400: 00000001:02000400:0.0:1789601416.611835:0:10189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789601416.839965:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601417.542659:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918278528:0@lo:41: 00000100:00100000:3.0:1789601417.542738:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601417.544656:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278528 00000100:00100000:2.0:1789601417.544669:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278528 00000100:00100000:2.0:1789601417.544743:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789601417.544754:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918278528:12345-0@lo:41: 00000004:00000024:2.0:1789601417.544795:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601417.544889:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918278528:12345-0@lo:41: Request processed in 136us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601417.544896:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601417.545166:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918278528:0@lo:41: 00010000:00010000:0.0:1789601417.861738:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601418.053939:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601418.053977:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918278656:0@lo:41: 00000100:00100000:3.0:1789601418.054064:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601418.054422:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278656 00000100:00100000:0.0:1789601418.054431:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278656 00000100:00100000:0.0:1789601418.054495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789601418.054504:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918278656:12345-0@lo:41: 00000004:00000024:0.0:1789601418.054546:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789601418.054633:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918278656:12345-0@lo:41: Request processed in 131us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601418.054640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601418.054774:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918278656:0@lo:41: 00010000:00010000:2.0:1789601418.889098:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601419.054380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601419.054409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601419.054444:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304768 00000100:00100000:1.0:1789601419.054456:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304768 00000100:00100000:1.0:1789601419.054520:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1789601419.054526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601419.054535:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898304768:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601419.054589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601419.054636:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898304768:12345-192.168.203.48@tcp:400: Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601419.054643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:1.0:1789601419.054661:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304896 00000100:00100000:1.0:1789601419.054665:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304896 00000100:00100000:0.0:1789601419.054671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601419.054695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789601419.054702:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898304896:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789601419.054726:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898304896:12345-192.168.203.48@tcp:400: Request processed in 25us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601419.054733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00080000:1.0:1789601419.054751:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601419.054756:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601419.054840:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305024 00000100:00100000:0.0:1789601419.054845:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305024 00000100:00100000:0.0:1789601419.054890:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305152 00000100:00100000:0.0:1789601419.054893:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305152 00000100:00080000:1.0:1789601419.054902:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601419.054906:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601419.054925:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789601419.054933:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898305024:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601419.054977:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898305024:12345-192.168.203.48@tcp:400: Request processed in 45us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601419.054984:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789601419.054997:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789601419.055003:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898305152:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601419.055024:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898305152:12345-192.168.203.48@tcp:400: Request processed in 22us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601419.055031:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789601419.055048:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898304640 00000100:00100000:0.0:1789601419.055052:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898304640 00000100:00100000:0.0:1789601419.055081:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:0.0:1789601419.055089:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898304640:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601419.055114:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898304640:12345-192.168.203.48@tcp:400: Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601419.055120:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00010000:00010000:2.0:1789601419.909744:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601420.102248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918278784:0@lo:13: 00000100:00100000:3.0:1789601420.102343:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601420.102520:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278784 00000100:00100000:2.0:1789601420.102530:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278784 00000100:00100000:2.0:1789601420.102616:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601420.102639:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918278784:12345-0@lo:13: 00002000:00000024:2.0:1789601420.102669:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601420.102718:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918278784:12345-0@lo:13: Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601420.102724:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789601420.102849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601420.102880:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a7800 x1876532918278784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601420.102900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918278784:0@lo:13: 00000100:00100000:3.0:1789601420.104219:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601420.107323:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918278912:0@lo:13: 00000100:00100000:3.0:1789601420.107399:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601420.110469:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918278912 00000100:00100000:2.0:1789601420.110486:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918278912 00000100:00100000:2.0:1789601420.110924:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601420.110936:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918278912:12345-0@lo:13: 00002000:00000024:2.0:1789601420.110963:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601420.112239:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918278912:12345-0@lo:13: Request processed in 1303us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601420.112257:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789601420.112627:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73b0380 x1876532918278912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601420.112650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918278912:0@lo:13: 00000100:00080000:3.0:1789601420.115361:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601420.934872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601421.638177:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918279040:0@lo:400: 00000100:00100000:1.0:1789601421.638285:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638353:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918279552:0@lo:400: 00000100:00100000:1.0:1789601421.638383:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638406:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918280064:0@lo:400: 00000100:00100000:1.0:1789601421.638429:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638446:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918280576:0@lo:400: 00000100:00100000:1.0:1789601421.638465:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638492:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789601421.638498:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918279168:0@lo:400: 00000100:00100000:1.0:1789601421.638522:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638541:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918279680:0@lo:400: 00000100:00100000:1.0:1789601421.638658:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638680:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918280192:0@lo:400: 00000100:00100000:1.0:1789601421.638704:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.638760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279040 00000100:00100000:1.0:1789601421.638769:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279040 00000100:00100000:1.0:1789601421.638822:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789601421.638832:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918279040:12345-0@lo:400: 00000100:00100000:1.0:1789601421.638887:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918279040:12345-0@lo:400: Request processed in 56us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.638893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789601421.638926:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279552 00000100:00100000:1.0:1789601421.638930:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279552 00000100:00100000:1.0:1789601421.638959:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601421.638966:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918279552:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639001:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918279552:12345-0@lo:400: Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639014:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601421.639034:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280064 00000100:00100000:1.0:1789601421.639037:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280064 00000100:00100000:1.0:1789601421.639063:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280576 00000100:00100000:1.0:1789601421.639065:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280576 00000100:00100000:1.0:1789601421.639095:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601421.639101:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918280064:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639131:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918280064:12345-0@lo:400: Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639136:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601421.639147:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601421.639153:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918280576:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639178:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918280576:12345-0@lo:400: Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639182:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601421.639204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279168 00000100:00100000:1.0:1789601421.639207:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279168 00000100:00100000:1.0:1789601421.639231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279680 00000100:00100000:1.0:1789601421.639234:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279680 00000100:00100000:1.0:1789601421.639246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280192 00000100:00100000:1.0:1789601421.639248:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280192 00000100:00100000:1.0:1789601421.639263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601421.639269:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918279168:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639298:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918279168:12345-0@lo:400: Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601421.639331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789601421.639337:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918279680:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639375:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918279680:12345-0@lo:400: Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789601421.639394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789601421.639399:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918280192:12345-0@lo:400: 00000100:00100000:1.0:1789601421.639427:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918280192:12345-0@lo:400: Request processed in 28us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.639432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789601421.639462:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601421.639468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601421.639506:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918279168:0@lo:400: 00000100:00100000:1.0:1789601421.639517:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918279680:0@lo:400: 00000100:00100000:1.0:1789601421.639525:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918280192:0@lo:400: 00000100:00100000:1.0:1789601421.639534:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918279040:0@lo:400: 00000100:00100000:1.0:1789601421.639542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918279552:0@lo:400: 00010000:00080000:1.0:1789601421.639576:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3435500 x1876532918280064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.639588:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918280064:0@lo:400: 00010000:00080000:1.0:1789601421.639603:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3434700 x1876532918280576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.639611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918280576:0@lo:400: 00000020:00000080:3.0:1789601421.641761:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdde478d00 20000000:00000080:3.0:1789601421.641783:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df3c35cc800 uarg=0000000000000000 20000000:01000000:3.0:1789601421.641832:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789601421.641835:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789601421.641838:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789601421.641844:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789601421.641850:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789601421.641922:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601421.641926:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000100:00100000:0.0:1789601421.642244:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918280704:0@lo:13: 00000100:00100000:0.0:1789601421.642325:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.642378:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280704 00000100:00100000:0.0:1789601421.642392:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280704 00000100:00100000:0.0:1789601421.642438:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789601421.642447:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918280704:12345-0@lo:13: 00002000:00000024:0.0:1789601421.642476:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601421.642523:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918280704:12345-0@lo:13: Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.642530:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789601421.642738:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92300 x1876532918280704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601421.642758:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918280704:0@lo:13: 00000100:00100000:2.0:1789601421.642922:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918279296:0@lo:400: 00000100:00100000:2.0:1789601421.642964:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918279808:0@lo:400: 00000100:00100000:2.0:1789601421.643061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918280320:0@lo:400: 00000100:00100000:2.0:1789601421.643109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918280832:0@lo:13: 00000100:00100000:2.0:1789601421.643156:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643177:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789601421.643185:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918279424:0@lo:400: 00000100:00100000:2.0:1789601421.643206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643222:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918279936:0@lo:400: 00000100:00100000:2.0:1789601421.643244:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.643269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918280448:0@lo:400: 00000100:00100000:2.0:1789601421.643289:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.643361:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279808 00000100:00100000:1.0:1789601421.643367:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279808 00000100:00100000:1.0:1789601421.643417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280320 00000100:00100000:1.0:1789601421.643421:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280320 00000100:00100000:1.0:1789601421.643436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279424 00000100:00100000:1.0:1789601421.643439:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279424 00000100:00100000:1.0:1789601421.643454:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789601421.643461:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918279808:12345-0@lo:400: 00000100:00100000:1.0:1789601421.643507:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918279808:12345-0@lo:400: Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.643514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789601421.643527:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601421.643532:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918280320:12345-0@lo:400: 00000100:00100000:1.0:1789601421.643603:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918280320:12345-0@lo:400: Request processed in 70us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.643610:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601421.643622:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601421.643628:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918279424:12345-0@lo:400: 00000100:00100000:1.0:1789601421.643656:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918279424:12345-0@lo:400: Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.643662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601421.643693:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918279424:0@lo:400: 00010000:00080000:1.0:1789601421.643705:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3434380 x1876532918279808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.643714:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918279808:0@lo:400: 00010000:00080000:1.0:1789601421.643723:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3437100 x1876532918280320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.643730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918280320:0@lo:400: 00000100:00100000:1.0:1789601421.643768:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279936 00000100:00100000:1.0:1789601421.643772:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279936 00000100:00100000:1.0:1789601421.643795:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280448 00000100:00100000:1.0:1789601421.643799:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280448 00000100:00100000:1.0:1789601421.643819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601421.643825:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918279936:12345-0@lo:400: 00000100:00100000:1.0:1789601421.643858:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918279936:12345-0@lo:400: Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.643864:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601421.643874:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601421.643880:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918280448:12345-0@lo:400: 00000100:00100000:1.0:1789601421.643906:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918280448:12345-0@lo:400: Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.643911:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789601421.643933:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601421.643939:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789601421.643955:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3436a00 x1876532918279936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.643965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918279936:0@lo:400: 00010000:00080000:1.0:1789601421.643975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3434a80 x1876532918280448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601421.643983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918280448:0@lo:400: 00000100:00100000:0.0:1789601421.644394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918279296 00000100:00100000:0.0:1789601421.644400:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918279296 00000100:00100000:0.0:1789601421.644442:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601421.644451:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918279296:12345-0@lo:400: 00000100:00100000:0.0:1789601421.644545:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918279296:12345-0@lo:400: Request processed in 95us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.644552:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789601421.644877:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918280832 00000100:00100000:2.0:1789601421.644884:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918280832 00000100:00100000:2.0:1789601421.644909:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601421.644916:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918280832:12345-0@lo:13: 00002000:00000024:2.0:1789601421.644934:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601421.644977:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918280832:12345-0@lo:13: Request processed in 62us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.644984:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601421.645224:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918279296:0@lo:400: 00010000:00080000:3.0:1789601421.645240:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73b0700 x1876532918280832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601421.645276:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918280832:0@lo:13: 00000040:00080000:1.0:1789601421.645716:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789601421.646058:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789601421.646094:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789601421.646112:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789601421.646124:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789601421.646127:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789601421.647102:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789601421.651957:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789601421.652027:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789601421.652048:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789601421.652068:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789601421.652071:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789601421.652663:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789601421.652910:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789601421.652937:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789601421.652952:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789601421.652967:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789601421.652969:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789601421.653256:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789601421.653403:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789601421.653424:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789601421.653440:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789601421.653448:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789601421.653450:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789601421.653762:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789601421.653913:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789601421.653934:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789601421.653959:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1789601421.653975:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789601421.653999:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654020:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654028:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f140d expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654036:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f144c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654043:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f145a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654051:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654058:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654065:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654073:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654080:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654103:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654110:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654117:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654162:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654179:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 9 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.654195:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918280960:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601421.654324:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654333:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 9 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.654342:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281088:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601421.654376:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654384:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 23 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.654406:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281216:0@lo:104: 00000100:00100000:0.0:1789601421.654455:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.654503:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281216 00000100:00100000:0.0:1789601421.654511:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281216 00000100:00100000:0.0:1789601421.654595:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601421.654605:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281216:12345-0@lo:104: 00010000:00010000:0.0:1789601421.654621:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654670:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601421.654676:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281216:12345-0@lo:104: Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.654683:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789601421.654717:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654726:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 23 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.654734:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281344:0@lo:104: 00000100:00100000:0.0:1789601421.654758:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.654783:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281344 00000100:00100000:0.0:1789601421.654786:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281344 00000100:00100000:0.0:1789601421.654809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601421.654814:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281344:12345-0@lo:104: 00010000:00010000:0.0:1789601421.654823:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654870:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789601421.654876:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281344:12345-0@lo:104: Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.654882:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789601421.654912:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.654920:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 23 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.654927:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281472:0@lo:104: 00000100:00100000:0.0:1789601421.654949:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.654968:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281472 00000100:00100000:0.0:1789601421.654971:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281472 00000100:00100000:0.0:1789601421.654991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601421.654997:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281472:12345-0@lo:104: 00010000:00010000:0.0:1789601421.655005:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655038:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789601421.655043:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281472:12345-0@lo:104: Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.655049:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789601421.655065:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789601421.655072:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655079:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601421.655090:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655099:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601421.655108:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601421.655114:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601421.655144:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655151:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601421.655172:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383a00/0x74872e3eca9f14f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655193:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601421.655196:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655203:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601421.655206:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655213:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601421.655229:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601421.655234:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601421.655248:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655253:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601421.655277:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655285:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382600/0x74872e3eca9f14ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655294:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601421.655297:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655314:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601421.655318:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655324:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601421.655330:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601421.655336:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601421.655356:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655362:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601421.655368:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655375:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f14a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f14ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.655384:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.655386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.655388:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601421.655401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918281856:0@lo:103: 00000100:00100000:0.0:1789601421.655437:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.655463:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601421.655469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918281728:0@lo:103: 00000100:00100000:0.0:1789601421.655503:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.655534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281856 00000100:00100000:0.0:1789601421.655538:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281856 00000100:00100000:3.0:1789601421.655873:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601421.655885:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918281600:0@lo:103: 00000100:00100000:3.0:1789601421.655914:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601421.656133:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601421.656141:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601421.656164:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281728 00000100:00100000:2.0:1789601421.656169:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281728 00010000:00010000:2.0:1789601421.656192:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 25 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.656278:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 25 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.656318:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281600 00000100:00100000:2.0:1789601421.656322:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281600 00010000:00010000:2.0:1789601421.656335:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 26 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601421.656490:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601421.656503:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+26:3646:x1876532918281728:12345-0@lo:103: 00010000:00010000:1.0:1789601421.656526:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601421.656533:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 26 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656544:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 26 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656595:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601421.656645:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+26:3646:x1876532918281728:12345-0@lo:103: Request processed in 147us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.656653:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601421.656674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601421.656681:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3646:x1876532918281856:12345-0@lo:103: 00010000:00010000:1.0:1789601421.656689:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601421.656694:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 25 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656702:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 25 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656712:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601421.656735:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3646:x1876532918281856:12345-0@lo:103: Request processed in 55us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.656741:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601421.656786:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601421.656792:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918281600:12345-0@lo:103: 00010000:00010000:1.0:1789601421.656800:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601421.656804:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 24 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656819:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 24 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601421.656829:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601421.656861:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918281600:12345-0@lo:103: Request processed in 70us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601421.656867:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601421.656906:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918281600:0@lo:103: 00000100:00100000:3.0:1789601421.657002:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918281728:0@lo:103: 00000100:00100000:3.0:1789601421.657009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918281856:0@lo:103: 00010000:00010000:0.0:1789601421.657167:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657178:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 23 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.657189:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281984:0@lo:104: 00000100:00100000:0.0:1789601421.657223:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.657267:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789601421.657277:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918281984 00000100:00100000:0.0:1789601421.657282:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918281984 00000100:00100000:0.0:1789601421.657330:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601421.657338:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c29ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281984:12345-0@lo:104: 00010000:00010000:0.0:1789601421.657349:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657385:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601421.657391:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c29ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918281984:12345-0@lo:104: Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.657397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789601421.657431:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601421.657437:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657444:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601421.657448:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657457:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601421.657464:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601421.657471:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601421.657496:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657514:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601421.657531:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657537:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3466800/0x74872e3eca9f1484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f148b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.657552:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.657681:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.657704:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.657714:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 23 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.657725:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282240:0@lo:104: 00000100:00100000:0.0:1789601421.657748:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.657771:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282240 00000100:00100000:0.0:1789601421.657775:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282240 00000100:00100000:0.0:1789601421.657799:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789601421.657805:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918282240:12345-0@lo:104: 00010000:00010000:0.0:1789601421.657814:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.658072:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601421.658079:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918282240:12345-0@lo:104: Request processed in 273us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.658095:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789601421.658128:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.658136:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 23 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.658144:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282368:0@lo:104: 00000100:00100000:0.0:1789601421.658167:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601421.658191:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.658199:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 23 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.658206:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282496:0@lo:104: 00000100:00100000:0.0:1789601421.658225:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601421.658244:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282368 00000100:00100000:0.0:1789601421.658247:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282368 00000100:00100000:0.0:1789601421.658265:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282496 00000100:00100000:0.0:1789601421.658267:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282496 00000100:00100000:0.0:1789601421.658277:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789601421.658284:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10337:x1876532918282368:12345-0@lo:104: 00010000:00010000:0.0:1789601421.658291:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.658425:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601421.658439:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918282112:0@lo:103: 00000100:00100000:2.0:1789601421.658468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.658502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282112 00000100:00100000:2.0:1789601421.658506:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282112 00010000:00010000:2.0:1789601421.658531:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 24 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.658550:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601421.658577:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918282112:12345-0@lo:103: 00010000:00010000:2.0:1789601421.658589:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.658594:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 24 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.658603:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 24 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.658619:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601421.658646:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918282112:12345-0@lo:103: Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.658651:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601421.658685:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918282112:0@lo:103: 00000100:00100000:2.0:1789601421.658939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601421.658948:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10337:x1876532918282496:12345-0@lo:104: 00010000:00010000:2.0:1789601421.658957:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.658994:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789601421.658999:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10337:x1876532918282496:12345-0@lo:104: Request processed in 54us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.659006:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789601421.659024:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789601421.659029:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659036:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601421.659040:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659056:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601421.659061:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601421.659066:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601421.659089:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659095:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601421.659120:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659127:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362800/0x74872e3eca9f1468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f146f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659139:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601421.659141:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659147:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601421.659150:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659156:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601421.659163:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601421.659175:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601421.659191:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659197:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601421.659214:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659220:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362e00/0x74872e3eca9f145a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1461 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659229:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601421.659233:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659238:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601421.659240:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659247:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601421.659252:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601421.659257:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601421.659269:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659275:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601421.659287:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659293:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f144c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1453 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659311:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601421.659314:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601421.659315:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601421.659331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918282624:0@lo:103: 00000100:00100000:2.0:1789601421.659358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.659393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918282752:0@lo:103: 00000100:00100000:2.0:1789601421.659415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.659432:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601421.659437:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918282880:0@lo:103: 00000100:00100000:2.0:1789601421.659456:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.659478:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282624 00000100:00100000:2.0:1789601421.659483:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282624 00010000:00010000:2.0:1789601421.659500:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 24 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.659518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282752 00000100:00100000:2.0:1789601421.659521:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282752 00010000:00010000:2.0:1789601421.659532:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 25 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.659540:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918282880 00000100:00100000:2.0:1789601421.659542:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918282880 00010000:00010000:2.0:1789601421.659551:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 26 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.659596:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601421.659602:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+26:3648:x1876532918282624:12345-0@lo:103: 00010000:00010000:2.0:1789601421.659629:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.659634:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 26 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659643:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 26 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659654:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601421.659681:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+26:3648:x1876532918282624:12345-0@lo:103: Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.659687:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601421.659702:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601421.659707:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3645:x1876532918282752:12345-0@lo:103: 00010000:00010000:2.0:1789601421.659714:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.659718:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 25 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659726:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 25 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.659736:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601421.659923:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.660007:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789601421.660016:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918282368:12345-0@lo:104: Request processed in 1731us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601421.660032:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789601421.660055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601421.660086:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.660096:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 25 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660106:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918283008:0@lo:104: 00000100:00100000:0.0:1789601421.660136:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601421.660206:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601421.660214:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 25 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660222:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918283136:0@lo:104: 00000100:00100000:0.0:1789601421.660256:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.660284:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3645:x1876532918282752:12345-0@lo:103: Request processed in 577us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.660291:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601421.660313:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601421.660325:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918282880:12345-0@lo:103: 00010000:00010000:2.0:1789601421.660333:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.660337:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 24 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.660345:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 24 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.660356:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601421.660378:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918282880:12345-0@lo:103: Request processed in 54us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.660386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601421.660427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918282624:0@lo:103: 00000100:00100000:0.0:1789601421.660576:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789601421.660594:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f14fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f14f4 expref: 23 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660606:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281216:0@lo:104: 00010000:00010000:0.0:1789601421.660615:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f14d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f14ca expref: 22 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660622:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281344:0@lo:104: 00010000:00010000:0.0:1789601421.660630:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f14ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f14a7 expref: 21 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660649:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281472:0@lo:104: 00010000:00010000:0.0:1789601421.660662:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f148b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1484 expref: 20 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660670:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281984:0@lo:104: 00010000:00010000:0.0:1789601421.660679:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f146f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1468 expref: 19 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660686:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282240:0@lo:104: 00010000:00010000:0.0:1789601421.660694:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362c00/0x74872e3eca9f1461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f145a expref: 18 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660703:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282368:0@lo:104: 00010000:00010000:0.0:1789601421.660712:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f1453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f144c expref: 17 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.660720:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918282496:0@lo:104: 00000100:00100000:2.0:1789601421.661065:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283008 00000100:00100000:2.0:1789601421.661071:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283008 00000100:00100000:2.0:1789601421.661105:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283136 00000100:00100000:2.0:1789601421.661108:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283136 00000100:00100000:2.0:1789601421.661122:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601421.661129:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10337:x1876532918283008:12345-0@lo:104: 00010000:00010000:2.0:1789601421.661141:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661191:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601421.661197:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10337:x1876532918283008:12345-0@lo:104: Request processed in 69us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.661203:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601421.661218:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601421.661224:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918283136:12345-0@lo:104: 00010000:00010000:2.0:1789601421.661242:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661275:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601421.661280:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10337:x1876532918283136:12345-0@lo:104: Request processed in 57us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.661287:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789601421.661313:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601421.661319:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661326:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601421.661331:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661340:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601421.661347:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601421.661353:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601421.661380:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661387:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601421.661404:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661411:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0030600/0x74872e3eca9f140d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1414 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661432:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601421.661435:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661440:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601421.661443:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661450:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601421.661456:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601421.661461:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601421.661475:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661482:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601421.661488:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661493:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0031800/0x74872e3eca9f13e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f13ea expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661508:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601421.661509:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601421.661511:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601421.661528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918283392:0@lo:103: 00000100:00100000:2.0:1789601421.661584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601421.661598:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918282752:0@lo:103: 00000100:00100000:2.0:1789601421.661609:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601421.661614:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918283264:0@lo:103: 00000100:00100000:1.0:1789601421.661614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918282880:0@lo:103: 00000100:00100000:2.0:1789601421.661635:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601421.661655:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283392 00000100:00100000:2.0:1789601421.661664:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283392 00000100:00100000:0.0:1789601421.661728:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918283008:0@lo:104: 00000100:00100000:0.0:1789601421.661735:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918283136:0@lo:104: 00010000:00010000:2.0:1789601421.661891:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 17 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.661914:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283264 00000100:00100000:2.0:1789601421.661918:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283264 00010000:00010000:2.0:1789601421.661929:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 18 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.661947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601421.661954:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3638050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:3648:x1876532918283392:12345-0@lo:103: 00010000:00010000:2.0:1789601421.661964:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.661970:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 18 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661979:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 18 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.661991:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0031a00/0x74872e3eca9f13ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f13e3 expref: 18 pid: 6514 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.662002:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601421.662030:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3638050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:3648:x1876532918283392:12345-0@lo:103: Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.662035:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601421.662080:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601421.662085:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:3648:x1876532918283264:12345-0@lo:103: 00010000:00010000:2.0:1789601421.662092:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.662097:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 16 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.662105:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 16 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.662114:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0031c00/0x74872e3eca9f1414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f140d expref: 16 pid: 6515 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.662121:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601421.662140:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:3648:x1876532918283264:12345-0@lo:103: Request processed in 55us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.662145:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601421.662175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918283264:0@lo:103: 00000100:00100000:2.0:1789601421.662182:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918283392:0@lo:103: 00010000:00010000:2.0:1789601421.662200:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601421.670018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601421.670070:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918280960:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601421.670084:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876532918281088:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601421.670133:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601421.670458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601421.670519:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305280 00000100:00100000:2.0:1789601421.670519:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305408 00000100:00100000:3.0:1789601421.670528:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305280 00000100:00100000:2.0:1789601421.670528:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305408 00010000:00010000:3.0:1789601421.670628:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 11 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601421.670669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1789601421.670680:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:2416:x1876532898305280:12345-192.168.203.48@tcp:103: 00010000:00010000:3.0:1789601421.670714:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601421.670721:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 11 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601421.670734:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 11 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.670837:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 11 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.670916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:2.0:1789601421.670924:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:2416:x1876532898305408:12345-192.168.203.48@tcp:103: 00010000:00010000:2.0:1789601421.670932:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601421.670937:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 11 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672274:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 11 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601421.672324:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363400/0x74872e3eca9f1510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48968 expref: 11 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601421.672346:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601421.672477:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383c00/0x74872e3eca9f1509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48961 expref: 10 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672490:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672499:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672520:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672528:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672534:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672541:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672592:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601421.672598:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672609:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672623:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601421.672635:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601421.672765:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601421.672773:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:2416:x1876532898305280:12345-192.168.203.48@tcp:103: Request processed in 2094us (2313us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601421.672774:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601421.672784:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00010000:00010000:0.0:1789601421.672792:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f154f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601421.673023:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:2416:x1876532898305408:12345-192.168.203.48@tcp:103: Request processed in 2099us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601421.673032:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00010000:00010000:0.0:1789601421.960093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601422.664872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601422.664905:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918283520:0@lo:41: 00000100:00100000:2.0:1789601422.664995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601422.665278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283520 00000100:00100000:0.0:1789601422.665288:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283520 00000100:00100000:0.0:1789601422.665482:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789601422.665493:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918283520:12345-0@lo:41: 00000004:00000024:0.0:1789601422.665971:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601422.666044:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918283520:12345-0@lo:41: Request processed in 553us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.666052:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789601422.666333:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918283520:0@lo:41: 10000000:01000000:2.0:1789601422.856100:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601422.856110:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df501e60000 from 48 10000000:01000000:2.0:1789601422.856117:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601422.856173:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.856187:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.856199:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.856244:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283648:0@lo:101: 00000100:00100000:2.0:1789601422.856340:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.856473:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.857955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283648 00000100:00100000:0.0:1789601422.857967:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283648 00000100:00100000:0.0:1789601422.858090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789601422.858102:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+15:6519:x1876532918283648:12345-0@lo:101: 00010000:00010000:0.0:1789601422.858120:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601422.858140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f155d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1556 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.858170:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1556 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.858183:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1556 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.858192:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466000, rc 0) 00000100:00100000:0.0:1789601422.858272:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918283648:12345-0@lo:101: Request processed in 172us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.858304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789601422.858410:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283648:0@lo:101: 00010000:00010000:3.0:1789601422.858429:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.858438:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601422.858528:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283776:0@lo:501: 00000100:00100000:3.0:1789601422.858587:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.866089:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.870798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283776 00000100:00100000:2.0:1789601422.870818:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283776 00000100:00100000:2.0:1789601422.871057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789601422.871068:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918283776:12345-0@lo:501: 00000100:00100000:2.0:1789601422.871445:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918283776:12345-0@lo:501: Request processed in 307us (12785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.871455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789601422.871719:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283776:0@lo:501: 00000100:00100000:3.0:1789601422.871783:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283904:0@lo:503: 00000100:00100000:3.0:1789601422.872038:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.872127:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.872169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918283904 00000100:00100000:2.0:1789601422.872175:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918283904 00000100:00100000:2.0:1789601422.872202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789601422.872209:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918283904:12345-0@lo:503: 00000100:00100000:2.0:1789601422.872361:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918283904:12345-0@lo:503: Request processed in 151us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.872368:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789601422.872500:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918283904:0@lo:503: 00000100:00100000:2.0:1789601422.873120:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10354:1876532918284032:0@lo:502: 00000100:00100000:2.0:1789601422.873164:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.873230:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.873267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284032 00000100:00100000:3.0:1789601422.873273:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284032 00000100:00100000:3.0:1789601422.873310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789601422.873317:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:10354:x1876532918284032:12345-0@lo:502: 00000100:00100000:3.0:1789601422.873535:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:10354:x1876532918284032:12345-0@lo:502: Request processed in 217us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.873544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789601422.873720:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10354:1876532918284032:0@lo:502: 00000100:00100000:2.0:1789601422.873763:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10354:1876532918284160:0@lo:502: 00000100:00100000:2.0:1789601422.873799:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.873827:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.874161:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284160 00000100:00100000:1.0:1789601422.874167:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284160 00000100:00100000:1.0:1789601422.874202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789601422.874211:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:10354:x1876532918284160:12345-0@lo:502: 00000100:00100000:1.0:1789601422.874310:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:10354:x1876532918284160:12345-0@lo:502: Request processed in 101us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.874318:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789601422.874433:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10354:1876532918284160:0@lo:502: 00000040:00080000:2.0:1789601422.874459:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789601422.878102:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789601422.878148:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601422.878162:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.878188:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601422.878200:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789601422.878203:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789601422.878206:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789601422.878254:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.878263:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.878275:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601422.878312:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284288:0@lo:101: 00000100:00100000:3.0:1789601422.878406:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.878590:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23ac480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.879257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284288 00000100:00100000:1.0:1789601422.879267:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284288 00000100:00100000:1.0:1789601422.879366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789601422.879375:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+16:6519:x1876532918284288:12345-0@lo:101: 00010000:00010000:1.0:1789601422.879391:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601422.879407:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f156b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1564 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.879496:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1564 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.879521:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1564 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.879530:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee000, rc 0) 00000100:00100000:1.0:1789601422.879809:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284288:12345-0@lo:101: Request processed in 435us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.879816:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789601422.884382:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284288:0@lo:101: 00010000:00010000:2.0:1789601422.884429:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.884443:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.884702:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284416:0@lo:501: 00000100:00100000:2.0:1789601422.884776:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.884817:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.884937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284416 00000100:00100000:0.0:1789601422.885004:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284416 00000100:00100000:0.0:1789601422.885057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789601422.885066:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284416:12345-0@lo:501: 00000100:00100000:0.0:1789601422.885278:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284416:12345-0@lo:501: Request processed in 213us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.885286:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789601422.885495:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284416:0@lo:501: 00000100:00100000:2.0:1789601422.885524:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284544:0@lo:503: 00000100:00100000:2.0:1789601422.885700:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.885768:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.894527:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284544 00000100:00100000:3.0:1789601422.894654:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284544 00000100:00100000:3.0:1789601422.894780:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789601422.894792:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284544:12345-0@lo:503: 00000100:00100000:3.0:1789601422.895460:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284544:12345-0@lo:503: Request processed in 668us (9757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.895470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789601422.895648:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284544:0@lo:503: 00000100:00100000:1.0:1789601422.900531:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10355:1876532918284672:0@lo:502: 00000100:00100000:1.0:1789601422.900700:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.905854:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d1057c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.905882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284672 00000100:00100000:3.0:1789601422.905895:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284672 00000100:00100000:2.0:1789601422.906102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789601422.906113:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:10355:x1876532918284672:12345-0@lo:502: 00000100:00100000:2.0:1789601422.906331:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:10355:x1876532918284672:12345-0@lo:502: Request processed in 219us (5631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.906339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789601422.907524:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10355:1876532918284672:0@lo:502: 00000020:01000000:1.0:1789601422.907614:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601422.907629:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601422.907633:0:10355:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789601422.907640:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789601422.907687:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10355:1876532918284800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.907752:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.907794:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d1057c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.907848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284800 00000100:00100000:2.0:1789601422.907855:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284800 00000100:00100000:2.0:1789601422.907901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789601422.907909:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:10355:x1876532918284800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.908028:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:10355:x1876532918284800:12345-0@lo:502:llog_process_th.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.908035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789601422.908123:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10355:1876532918284800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601422.908141:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601422.908146:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601422.908147:0:10355:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789601422.908152:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789601422.908428:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789601422.908448:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789601422.908459:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.908474:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601422.908485:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601422.908488:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f70a3000 from 48 10000000:01000000:2.0:1789601422.908492:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601422.908520:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.908529:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.908538:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.908552:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.908627:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.908646:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.908833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918284928 00000100:00100000:3.0:1789601422.908838:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918284928 00000100:00100000:3.0:1789601422.908862:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789601422.908868:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+17:6519:x1876532918284928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601422.908878:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601422.908901:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7362a00/0x74872e3eca9f1579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.908924:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362a00/0x74872e3eca9f1579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1572 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.908936:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7362a00/0x74872e3eca9f1579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1572 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.908967:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362a00, rc 0) 00000100:00100000:3.0:1789601422.909005:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918284928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.909012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789601422.909255:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918284928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601422.909269:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.909285:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.909359:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.909386:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.909407:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.909500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285056 00000100:00100000:3.0:1789601422.909505:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285056 00000100:00100000:3.0:1789601422.909521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789601422.909527:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918285056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.909676:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918285056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.909684:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789601422.910141:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.910181:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.910227:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.910258:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.911484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285184 00000100:00100000:1.0:1789601422.911497:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285184 00000100:00100000:1.0:1789601422.911617:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789601422.911630:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918285184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.911802:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918285184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.911810:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789601422.912520:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.913409:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10356:1876532918285312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.913499:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.913546:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9213180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.913725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285312 00000100:00100000:2.0:1789601422.913733:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285312 00000100:00100000:2.0:1789601422.913773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789601422.913782:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:10356:x1876532918285312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.913950:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:10356:x1876532918285312:12345-0@lo:502:llog_process_th.0 Request processed in 159us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.913958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789601422.914365:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10356:1876532918285312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.914481:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10356:1876532918285440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.914519:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.914547:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9213180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.915162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285440 00000100:00100000:2.0:1789601422.915176:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285440 00000100:00100000:2.0:1789601422.915207:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789601422.915215:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:10356:x1876532918285440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.915327:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:10356:x1876532918285440:12345-0@lo:502:llog_process_th.0 Request processed in 112us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.915334:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789601422.916233:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10356:1876532918285440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789601422.916269:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789601422.916496:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789601422.916518:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789601422.916529:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.916542:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601422.916552:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789601422.916585:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789601422.916591:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601422.916629:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.916638:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.916648:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.916670:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.916720:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.916753:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.916953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285568 00000100:00100000:1.0:1789601422.916971:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285568 00000100:00100000:1.0:1789601422.917014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789601422.917022:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+18:6519:x1876532918285568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601422.917035:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601422.917049:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1580 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.917073:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1580 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.917083:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1580 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.917109:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee400, rc 0) 00000100:00100000:1.0:1789601422.917248:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918285568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.917254:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789601422.917449:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601422.917463:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.917472:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.917537:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.917600:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.917617:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.917630:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285696 00000100:00100000:2.0:1789601422.917633:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285696 00000100:00100000:2.0:1789601422.917652:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789601422.917658:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918285696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.917784:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918285696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.917791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789601422.917818:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.917850:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.917890:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.917902:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.917911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285824 00000100:00100000:2.0:1789601422.917914:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285824 00000100:00100000:2.0:1789601422.917927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789601422.917932:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918285824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.918371:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918285824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 437us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.918379:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789601422.918427:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918285824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.918780:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10357:1876532918285952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.918814:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.918832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918285952 00000100:00100000:2.0:1789601422.918842:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918285952 00000100:00100000:2.0:1789601422.918859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789601422.918865:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:10357:x1876532918285952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.918928:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:10357:x1876532918285952:12345-0@lo:502:llog_process_th.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.918935:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789601422.919469:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.919486:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10357:1876532918285952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601422.919512:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601422.919523:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601422.919525:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789601422.919530:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789601422.919598:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10357:1876532918286080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601422.919636:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601422.919653:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.920064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286080 00000100:00100000:2.0:1789601422.920070:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286080 00000100:00100000:2.0:1789601422.920095:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789601422.920101:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:10357:x1876532918286080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.920374:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:10357:x1876532918286080:12345-0@lo:502:llog_process_th.0 Request processed in 273us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.920382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789601422.920603:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10357:1876532918286080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601422.920628:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601422.920634:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601422.920636:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789601422.920640:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1789601422.921005:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789601422.921025:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789601422.921035:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.921046:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601422.921058:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601422.921060:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4f8b56000 from 48 10000000:01000000:2.0:1789601422.921063:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601422.921090:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.921107:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.921117:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.921134:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.921234:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.921261:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.921315:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286208 00000100:00100000:0.0:1789601422.921321:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286208 00000100:00100000:0.0:1789601422.921360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789601422.921369:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:6519:x1876532918286208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601422.921378:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601422.921393:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f1595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f158e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.921549:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f1595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f158e expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.921672:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f1595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f158e expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.921682:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466600, rc 0) 00000100:00100000:0.0:1789601422.921722:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 354us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.921728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789601422.921813:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601422.921827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.921836:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.921888:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.921926:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.921942:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.922227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286336 00000100:00100000:0.0:1789601422.922232:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286336 00000100:00100000:0.0:1789601422.922264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789601422.922270:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601422.924046:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1767us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.924058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789601422.924199:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.924257:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.924327:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.924367:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.924546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286464 00000100:00100000:0.0:1789601422.924576:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286464 00000100:00100000:0.0:1789601422.924619:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789601422.924628:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601422.924728:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.924735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789601422.925272:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.926642:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10358:1876532918286592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.926725:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.926761:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.926805:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286592 00000100:00100000:0.0:1789601422.926815:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286592 00000100:00100000:0.0:1789601422.926867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789601422.926877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:10358:x1876532918286592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601422.927051:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:10358:x1876532918286592:12345-0@lo:502:llog_process_th.0 Request processed in 175us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.927059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789601422.927118:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10358:1876532918286592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.927160:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10358:1876532918286720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.927206:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.927225:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.927258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286720 00000100:00100000:3.0:1789601422.927264:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286720 00000100:00100000:3.0:1789601422.927315:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789601422.927323:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:10358:x1876532918286720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.927412:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:10358:x1876532918286720:12345-0@lo:502:llog_process_th.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.927423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789601422.927527:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10358:1876532918286720:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789601422.927545:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789601422.927667:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789601422.927691:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601422.927701:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.927711:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601422.927720:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789601422.927722:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789601422.927725:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789601422.927888:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.927895:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.927903:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601422.927914:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.927960:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.927996:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d92139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.928087:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286848 00000100:00100000:0.0:1789601422.928092:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286848 00000100:00100000:0.0:1789601422.928132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789601422.928141:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918286848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601422.928152:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601422.928167:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f15a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f159c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.928192:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f15a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f159c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.928206:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f15a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f159c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.928216:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466800, rc 0) 00000100:00100000:0.0:1789601422.928252:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918286848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.928258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789601422.928262:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601422.928284:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.928308:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601422.928369:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.928397:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.928421:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d92139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.928531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918286976 00000100:00100000:1.0:1789601422.928536:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918286976 00000100:00100000:1.0:1789601422.928646:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789601422.928656:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918286976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.928836:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918286976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.928843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789601422.928907:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918286976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.928955:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.928991:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.929017:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.929037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287104 00000100:00100000:0.0:1789601422.929043:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287104 00000100:00100000:0.0:1789601422.929077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789601422.929085:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918287104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601422.929176:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918287104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.929195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789601422.929247:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.930009:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10359:1876532918287232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.930065:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.930097:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c51b5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.930722:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287232 00000100:00100000:1.0:1789601422.930730:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287232 00000100:00100000:1.0:1789601422.930775:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789601422.930784:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10359:x1876532918287232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.930920:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10359:x1876532918287232:12345-0@lo:502:llog_process_th.0 Request processed in 137us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.930927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789601422.931067:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10359:1876532918287232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601422.931102:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601422.931113:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601422.931115:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789601422.931123:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789601422.931147:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10359:1876532918287360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.931242:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.931263:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.931327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287360 00000100:00100000:0.0:1789601422.931332:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287360 00000100:00100000:0.0:1789601422.931362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789601422.931369:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10359:x1876532918287360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601422.931444:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10359:x1876532918287360:12345-0@lo:502:llog_process_th.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.931452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789601422.931472:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10359:1876532918287360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601422.931495:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601422.931500:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601422.931502:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789601422.931505:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789601422.931628:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789601422.931654:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789601422.931665:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.931677:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601422.931689:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601422.931692:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4d017d800 from 48 10000000:01000000:2.0:1789601422.931696:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601422.931721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.931730:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.931739:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.931753:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.931782:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.931801:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.931902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287488 00000100:00100000:3.0:1789601422.931908:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287488 00000100:00100000:3.0:1789601422.931949:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789601422.931956:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918287488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601422.931966:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601422.931980:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f15b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f15aa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.932005:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f15b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f15aa expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.932016:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f15b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15aa expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.932025:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363c00, rc 0) 00000100:00100000:3.0:1789601422.932062:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918287488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.932067:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789601422.932105:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601422.932124:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.932133:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601422.932190:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.932216:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.932242:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601422.932370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287616 00000100:00100000:1.0:1789601422.932375:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287616 00000100:00100000:1.0:1789601422.932403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789601422.932410:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918287616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.932525:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918287616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.932532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789601422.934418:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.934484:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.934582:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.934621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287744 00000100:00100000:2.0:1789601422.934624:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.934630:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287744 00000100:00100000:3.0:1789601422.934694:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789601422.934704:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918287744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.934845:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918287744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.934853:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789601422.934929:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918287744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601422.935330:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10360:1876532918287872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.935364:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.935390:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.935432:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918287872 00000100:00100000:0.0:1789601422.935437:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918287872 00000100:00100000:0.0:1789601422.935467:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789601422.935474:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10360:x1876532918287872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601422.935587:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10360:x1876532918287872:12345-0@lo:502:llog_process_th.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.935595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789601422.935781:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10360:1876532918287872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.935819:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10360:1876532918288000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.935850:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.935901:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601422.936045:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288000 00000100:00100000:2.0:1789601422.936049:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288000 00000100:00100000:2.0:1789601422.936108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789601422.936115:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10360:x1876532918288000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601422.936194:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10360:x1876532918288000:12345-0@lo:502:llog_process_th.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.936200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789601422.936256:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10360:1876532918288000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789601422.936276:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789601422.936501:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789601422.936529:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601422.936540:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.936551:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601422.936593:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789601422.936597:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789601422.936601:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601422.936629:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.936638:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.936647:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601422.936661:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.936690:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.937007:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.937031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288128 00000100:00100000:0.0:1789601422.937035:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288128 00000100:00100000:2.0:1789601422.937070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789601422.937083:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918288128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601422.937094:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601422.937107:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383000/0x74872e3eca9f15bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f15b8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.937130:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383000/0x74872e3eca9f15bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f15b8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.937141:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383000/0x74872e3eca9f15bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15b8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.937150:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383000, rc 0) 00000100:00100000:2.0:1789601422.937195:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.937200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789601422.937254:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601422.937267:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.937276:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601422.937336:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.937365:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.937488:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.937524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288256 00000100:00100000:3.0:1789601422.937529:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288256 00000100:00100000:3.0:1789601422.937551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789601422.937728:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.937854:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.937861:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789601422.938322:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.938359:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.938404:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.938462:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8362300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.938492:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288384 00000100:00100000:3.0:1789601422.938497:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288384 00000100:00100000:3.0:1789601422.938583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789601422.938591:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.938681:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.938688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789601422.938764:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.939386:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10361:1876532918288512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.939425:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.939452:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d83629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.939488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288512 00000100:00100000:3.0:1789601422.939493:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288512 00000100:00100000:3.0:1789601422.939523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789601422.939530:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10361:x1876532918288512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.939639:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10361:x1876532918288512:12345-0@lo:502:llog_process_th.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.939646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789601422.939756:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10361:1876532918288512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601422.939778:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601422.939788:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601422.939791:0:10361:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789601422.939797:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789601422.939815:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10361:1876532918288640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601422.939843:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.939867:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d83629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601422.939989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288640 00000100:00100000:3.0:1789601422.939993:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288640 00000100:00100000:3.0:1789601422.940019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789601422.940025:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10361:x1876532918288640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601422.940091:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10361:x1876532918288640:12345-0@lo:502:llog_process_th.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601422.940098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789601422.940237:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10361:1876532918288640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601422.940253:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601422.940256:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601422.940258:0:10361:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789601422.940262:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789601422.940425:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1789601422.940444:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789601422.940454:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.940466:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601422.940477:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789601422.940480:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f3720000 from 1 10000000:01000000:3.0:1789601422.940483:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789601422.940507:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.940516:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.940524:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601422.940537:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601422.940591:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.940610:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.940654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288768 00000100:00100000:0.0:1789601422.940659:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288768 00000100:00100000:0.0:1789601422.940687:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789601422.940694:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918288768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601422.940702:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601422.940717:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467800/0x74872e3eca9f15cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f15c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.940739:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467800/0x74872e3eca9f15cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f15c6 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.940757:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467800/0x74872e3eca9f15cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15c6 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601422.940766:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467800, rc 0) 00000100:00100000:0.0:1789601422.940799:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918288768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601422.940804:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789601422.940971:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601422.940983:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601422.940998:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601422.941043:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601422.941069:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.941084:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d83629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601422.941124:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918288896 00000100:00100000:0.0:1789601422.941128:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918288896 00000100:00100000:0.0:1789601422.941152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789601422.941159:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918288896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601422.941288:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918288896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (217us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601422.941304:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789601422.941359:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918288896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789601422.941377:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789601422.941387:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601422.941395:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601422.981981:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601423.174231:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601423.174260:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918289024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601423.174367:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601423.174550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289024 00000100:00100000:2.0:1789601423.174596:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289024 00000100:00100000:2.0:1789601423.174753:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789601423.174767:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918289024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601423.174811:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601423.174868:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918289024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601423.174876:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601423.175050:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918289024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601424.005763:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601424.175732:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601424.175860:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601424.175893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601424.175935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601424.175954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305536 00000100:00100000:3.0:1789601424.175968:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601424.175974:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305536 00000100:00100000:2.0:1789601424.176064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:2.0:1789601424.176077:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:2415:x1876532898305536:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789601424.176172:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:2415:x1876532898305536:12345-192.168.203.48@tcp:400: Request processed in 98us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601424.176181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:0.0:1789601424.176359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306048 00000100:00100000:0.0:1789601424.176365:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306048 00000100:00100000:0.0:1789601424.176419:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305920 00000100:00100000:0.0:1789601424.176422:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305920 00000100:00100000:0.0:1789601424.176444:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601424.176457:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898306048:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601424.176488:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898306048:12345-192.168.203.48@tcp:400: Request processed in 37us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601424.176494:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601424.176508:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601424.176515:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898305920:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1789601424.176550:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898305920:12345-192.168.203.48@tcp:400: Request processed in 36us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601424.176593:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00080000:2.0:1789601424.177228:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601424.177234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601424.177446:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305792 00000100:00100000:1.0:1789601424.177453:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305792 00000100:00100000:1.0:1789601424.177507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898305664 00000100:00100000:1.0:1789601424.177510:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898305664 00000100:00100000:1.0:1789601424.177533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:1.0:1789601424.177539:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898305792:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789601424.177611:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898305792:12345-192.168.203.48@tcp:400: Request processed in 71us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601424.177618:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:1.0:1789601424.177632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:1.0:1789601424.177638:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898305664:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789601424.177662:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898305664:12345-192.168.203.48@tcp:400: Request processed in 24us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601424.177668:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00080000:2.0:1789601424.177806:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601424.177810:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789601425.029821:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601425.221928:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601425.221955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918289152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601425.222033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601425.222618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918289280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601425.222651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601425.225287:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289152 00000100:00100000:2.0:1789601425.225304:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289152 00000100:00100000:2.0:1789601425.225380:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289280 00000100:00100000:2.0:1789601425.225384:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289280 00000100:00100000:2.0:1789601425.225411:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601425.225421:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918289152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601425.225458:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601425.225697:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918289152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601425.225705:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601425.225726:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601425.225734:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918289280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601425.225745:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601425.225772:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918289280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601425.225778:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789601425.226001:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8c380 x1876532918289280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601425.226023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918289280:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789601425.226036:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3437b80 x1876532918289152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601425.226047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918289152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789601425.226126:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789601426.054377:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601426.758287:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601426.758325:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918289408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601426.760599:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.762361:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918289536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601426.762420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601426.762586:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289408 00000100:00100000:1.0:1789601426.762595:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289408 00000100:00100000:1.0:1789601426.762728:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289536 00000100:00080000:2.0:1789601426.762779:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601426.762824:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289536 00000100:00100000:1.0:1789601426.762856:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601426.762866:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918289408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601426.762893:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601426.762938:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918289408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.762945:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601426.762961:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601426.762966:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918289536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601426.762973:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601426.762991:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918289536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.762996:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789601426.763042:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789601426.763072:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73b1880 x1876532918289536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601426.763090:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918289536:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789601426.763111:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8c380 x1876532918289408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601426.763122:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918289408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601426.764895:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918289792:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.764958:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601426.764996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918290304:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.765017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601426.765037:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918290816:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.765057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918289920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.765084:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789601426.765089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918289664:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765104:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601426.765113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765124:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918290432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765143:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918290944:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765174:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765185:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789601426.765190:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918290048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.765205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918290176:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765209:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765219:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.765224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765237:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601426.765253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918290688:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765275:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289920 00000100:00100000:2.0:1789601426.765282:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289920 00000100:00100000:0.0:1789601426.765287:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601426.765323:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290176 00000100:00100000:2.0:1789601426.765326:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290176 00000100:00100000:2.0:1789601426.765341:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789601426.765348:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765401:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918289920:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765414:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789601426.765444:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601426.765451:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918290176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765482:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918290176:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765488:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601426.765524:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918289920:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765596:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289792 00000100:00100000:2.0:1789601426.765600:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289792 00000100:00100000:2.0:1789601426.765629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290304 00000100:00100000:2.0:1789601426.765632:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290304 00000100:00100000:2.0:1789601426.765651:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290816 00000100:00100000:2.0:1789601426.765653:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290816 00000100:00100000:2.0:1789601426.765664:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290432 00000100:00100000:2.0:1789601426.765666:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290432 00000100:00100000:2.0:1789601426.765677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290944 00000100:00100000:2.0:1789601426.765679:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290944 00000100:00100000:2.0:1789601426.765690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290048 00000100:00100000:2.0:1789601426.765693:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290048 00000100:00100000:2.0:1789601426.765705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789601426.765710:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765749:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918289792:12345-0@lo:400:kworker.0 Request processed in 38us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789601426.765766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601426.765771:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765797:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918290304:12345-0@lo:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601426.765820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789601426.765825:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765852:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918290816:12345-0@lo:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765857:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789601426.765867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789601426.765872:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765900:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918290432:12345-0@lo:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765905:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789601426.765915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601426.765921:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765945:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918290944:12345-0@lo:400:kworker.0 Request processed in 25us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765950:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601426.765960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789601426.765965:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918290048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.765989:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918290048:12345-0@lo:400:kworker.0 Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.765994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789601426.766010:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601426.766014:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601426.766035:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918290048:0@lo:400:kworker.0 00010000:00080000:2.0:1789601426.766057:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c4380 x1876532918290432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601426.766067:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918290432:0@lo:400:kworker.0 00010000:00080000:2.0:1789601426.766079:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6300 x1876532918290944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601426.766086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918290944:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.766119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290560 00000100:00100000:2.0:1789601426.766122:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290560 00000100:00100000:2.0:1789601426.766144:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918290688 00000100:00100000:2.0:1789601426.766147:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918290688 00000100:00100000:2.0:1789601426.766161:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601426.766167:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918290560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.766202:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918290560:12345-0@lo:400:kworker.0 Request processed in 34us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.766208:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601426.766218:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601426.766224:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918290688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.766229:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918290176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.766239:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918290816:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.766248:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918289792:0@lo:400:kworker.0 00000100:00100000:2.0:1789601426.766249:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918290688:12345-0@lo:400:kworker.0 Request processed in 27us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601426.766255:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601426.766257:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918290304:0@lo:400:kworker.0 00010000:00080000:2.0:1789601426.766288:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c7100 x1876532918290560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789601426.766288:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c5180 x1876532918290688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601426.766298:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789601426.766298:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918290688:0@lo:400:kworker.0 00000100:00100000:1.0:1789601426.770391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918289664 00000100:00100000:1.0:1789601426.770404:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918289664 00000100:00100000:1.0:1789601426.770477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789601426.770488:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601426.770620:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918289664:12345-0@lo:400:kworker.0 Request processed in 134us (5504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.770627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789601426.771921:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918289664:0@lo:400:kworker.0 00010000:00010000:2.0:1789601427.080030:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601427.238526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601427.238736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306176 00000100:00100000:0.0:1789601427.238748:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306176 00000100:00100000:0.0:1789601427.238833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:0.0:1789601427.238843:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:6189:x1876532898306176:12345-192.168.203.48@tcp:101: 00010000:00010000:0.0:1789601427.238862:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601427.238883:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f15d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.239289:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f15d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d8 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.239304:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f15d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d8 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.239315:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467600, rc 0) 00000100:00100000:0.0:1789601427.239730:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306176:12345-192.168.203.48@tcp:101: Request processed in 886us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.239738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:1.0:1789601427.247517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601427.247719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306304 00000100:00100000:2.0:1789601427.247730:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306304 00000100:00100000:2.0:1789601427.248338:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:2.0:1789601427.248351:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306304:12345-192.168.203.48@tcp:501: 00000100:00100000:2.0:1789601427.248637:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306304:12345-192.168.203.48@tcp:501: Request processed in 288us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.248645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:2.0:1789601427.253635:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601427.254208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306432 00000100:00100000:0.0:1789601427.254221:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306432 00000100:00100000:0.0:1789601427.254548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:0.0:1789601427.255189:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306432:12345-192.168.203.48@tcp:503: 00000100:00100000:0.0:1789601427.259619:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306432:12345-192.168.203.48@tcp:503: Request processed in 3116us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.259649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:3.0:1789601427.263666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601427.264183:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306560 00000100:00100000:1.0:1789601427.264196:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306560 00000100:00100000:1.0:1789601427.264361:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:1.0:1789601427.264372:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6687:x1876532898306560:12345-192.168.203.48@tcp:502: 00000100:00100000:1.0:1789601427.265332:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6687:x1876532898306560:12345-192.168.203.48@tcp:502: Request processed in 954us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601427.265342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:1.0:1789601427.276652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601427.277393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306688 00000100:00100000:0.0:1789601427.277408:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306688 00000100:00100000:0.0:1789601427.277539:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:0.0:1789601427.277551:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6687:x1876532898306688:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601427.279085:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6687:x1876532898306688:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 1523us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.279108:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:2.0:1789601427.291596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601427.293931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306816 00000100:00100000:1.0:1789601427.293949:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306816 00000100:00100000:1.0:1789601427.294030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:1.0:1789601427.294052:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898306816:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601427.294072:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601427.294492:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f15db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601427.294529:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f15db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489df expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601427.294541:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f15db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489df expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601427.294551:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eea00, rc 0) 00000100:00100000:1.0:1789601427.294671:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898306816:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 631us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601427.294678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:3.0:1789601427.325375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601427.332375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898306944 00000100:00100000:0.0:1789601427.332396:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898306944 00000100:00100000:2.0:1789601427.332637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:2.0:1789601427.332653:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898306944:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.332819:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898306944:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 170us (7458us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601427.332828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:3.0:1789601427.784126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601427.784159:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918291072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601427.784248:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601427.785037:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291072 00000100:00100000:0.0:1789601427.785047:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291072 00000100:00100000:0.0:1789601427.786420:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789601427.786440:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918291072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601427.786488:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601427.786663:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918291072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 231us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.786692:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789601427.786806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918291072:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789601428.101801:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601428.296605:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918291200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601428.296689:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601428.296747:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291200 00000100:00100000:0.0:1789601428.296757:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291200 00000100:00100000:0.0:1789601428.296810:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789601428.296821:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918291200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601428.296856:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601428.296914:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918291200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601428.296922:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601428.297093:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918291200:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1789601428.337469:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff79dbe290 20000000:00000080:2.0:1789601428.337487:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df4fbcef800 uarg=0000000000000000 20000000:01000000:2.0:1789601428.337545:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789601428.337550:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789601428.337892:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789601428.347324:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789601428.351075:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789601428.360344:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789601428.360381:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789601428.360396:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789601428.360412:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789601428.360432:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360465:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360473:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360480:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360487:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360496:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360503:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360546:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360589:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 9 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.360605:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291328:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601428.360715:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360723:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 23 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.360741:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291456:0@lo:104: 00000100:00100000:3.0:1789601428.360784:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601428.360815:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.360823:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 23 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.360831:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291584:0@lo:104: 00000100:00100000:3.0:1789601428.360854:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601428.360897:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789601428.360910:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291456 00000100:00100000:3.0:1789601428.360919:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291456 00000100:00100000:3.0:1789601428.360963:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291584 00000100:00100000:3.0:1789601428.360966:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291584 00000100:00100000:3.0:1789601428.360984:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789601428.360993:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10399:x1876532918291456:12345-0@lo:104: 00010000:00010000:3.0:1789601428.361007:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.361058:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601428.361065:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10399:x1876532918291456:12345-0@lo:104: Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601428.361072:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789601428.361092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789601428.361098:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10399:x1876532918291584:12345-0@lo:104: 00010000:00010000:3.0:1789601428.361106:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.361146:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789601428.361151:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10399:x1876532918291584:12345-0@lo:104: Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601428.361157:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1789601428.361210:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.361219:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 23 pid: 6515 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.361228:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291712:0@lo:104: 00010000:00010000:2.0:1789601428.364501:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601428.364512:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364525:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601428.364529:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364576:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601428.364586:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601428.364592:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601428.364666:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364672:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601428.364693:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364701:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383200/0x74872e3eca9f13ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1406 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364715:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601428.364718:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364722:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601428.364725:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364730:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601428.364736:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601428.364746:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601428.364758:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364762:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601428.364785:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364792:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f12d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f12e0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.364802:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601428.364804:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601428.364805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601428.364811:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601428.364828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918291840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601428.364889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601428.364944:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918291968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601428.364968:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601428.365007:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291840 00000100:00100000:2.0:1789601428.365015:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291840 00010000:00010000:2.0:1789601428.365045:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 24 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601428.365071:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291968 00000100:00100000:2.0:1789601428.365073:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291968 00010000:00010000:2.0:1789601428.365082:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 25 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601428.365111:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601428.365119:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3648:x1876532918291840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601428.365131:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601428.365135:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 25 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.365144:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 25 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.365159:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601428.365186:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3648:x1876532918291840:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.365193:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601428.365210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601428.365215:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918291968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601428.365221:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601428.365225:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 24 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.365231:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 24 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.365239:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601428.365270:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918291968:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.365276:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601428.365315:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918291968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601428.365347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918291840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601428.368209:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601428.368359:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601428.368377:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 23 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.368393:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918292096:0@lo:104: 00000100:00100000:3.0:1789601428.368444:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601428.368472:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789601428.368500:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0030c00/0x74872e3eca9f1406 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f13ff expref: 23 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.368515:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291456:0@lo:104: 00010000:00010000:3.0:1789601428.368526:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f12e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f12d9 expref: 22 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.368552:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291584:0@lo:104: 00000100:00100000:1.0:1789601428.368796:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918291712 00000100:00100000:1.0:1789601428.368805:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918291712 00000100:00100000:1.0:1789601428.368858:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292096 00000100:00100000:1.0:1789601428.368862:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292096 00000100:00100000:1.0:1789601428.368876:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601428.368885:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10399:x1876532918291712:12345-0@lo:104: 00010000:00010000:1.0:1789601428.368897:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.368950:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601428.368956:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:10399:x1876532918291712:12345-0@lo:104: Request processed in 72us (7705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601428.368963:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601428.368979:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601428.368984:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10399:x1876532918292096:12345-0@lo:104: 00010000:00010000:1.0:1789601428.368991:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369034:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601428.369040:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:10399:x1876532918292096:12345-0@lo:104: Request processed in 56us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601428.369045:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789601428.369061:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601428.369066:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369073:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601428.369084:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369093:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601428.369101:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601428.369107:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601428.369134:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369140:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601428.369162:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369169:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1529a00/0x74872e3eca9f1277 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f127e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369349:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601428.369354:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369361:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601428.369364:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369372:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601428.369390:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601428.369396:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601428.369412:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369418:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601428.369434:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369441:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1528e00/0x74872e3eca9f1223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f122a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.369454:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601428.369456:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601428.369458:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601428.369470:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918292224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601428.369501:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601428.369543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918292352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601428.369593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601428.369695:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292224 00000100:00100000:1.0:1789601428.369700:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292224 00010000:00010000:1.0:1789601428.369720:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 22 pid: 6515 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601428.369741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292352 00000100:00100000:1.0:1789601428.369743:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292352 00010000:00010000:1.0:1789601428.369754:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 23 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601428.369896:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601428.369906:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3646:x1876532918292224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601428.369916:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601428.369922:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 23 pid: 6515 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.369932:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 23 pid: 6515 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.369950:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601428.369983:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3646:x1876532918292224:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.369991:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789601428.370020:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601428.370172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601428.370179:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3647:x1876532918292352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601428.370540:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291328:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601428.370573:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f127e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1277 expref: 22 pid: 6515 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.370584:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918291712:0@lo:104: 00000100:00100000:3.0:1789601428.370594:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876532918292096:0@lo:104: 00010000:00010000:1.0:1789601428.370867:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601428.370873:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 21 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.370882:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 21 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.370895:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1528400/0x74872e3eca9f122a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1223 expref: 21 pid: 6516 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.370904:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601428.370936:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3647:x1876532918292352:12345-0@lo:103:ldlm_bl.0 Request processed in 759us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601428.370943:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601428.370994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918292352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601428.371016:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918292224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601428.371114:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601428.371597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601428.371714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307072 00000100:00100000:2.0:1789601428.371720:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307072 00010000:00010000:2.0:1789601428.371743:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601428.371769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:2.0:1789601428.371777:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898307072:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601428.371786:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601428.371791:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371801:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371825:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f151e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489a0 expref: 10 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371838:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371847:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371863:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371870:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371877:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371884:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371889:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601428.371894:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371900:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371924:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601428.371945:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601428.371994:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:2416:x1876532898307072:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.372012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00010000:00010000:1.0:1789601428.374657:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.374677:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.374685:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f15e2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601428.659120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601428.663293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307200 00000100:00100000:1.0:1789601428.663317:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307200 00000100:00100000:1.0:1789601428.663396:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:1.0:1789601428.663408:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+9:6189:x1876532898307200:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601428.663432:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601428.663458:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.663493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.663507:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601428.663517:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efc00, rc 0) 00000100:00100000:1.0:1789601428.663618:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898307200:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 211us (4798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601428.663626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:2.0:1789601428.675931:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601428.676090:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307328 00000100:00100000:0.0:1789601428.676104:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307328 00000100:00100000:0.0:1789601428.676162:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:0.0:1789601428.676179:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898307328:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601428.676393:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898307328:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 220us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601428.676401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:0.0:1789601428.679011:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601428.679125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307456 00000100:00100000:2.0:1789601428.679137:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307456 00000100:00100000:2.0:1789601428.679202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00100000:2.0:1789601428.679214:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898307456:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601428.679428:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6189:x1876532898307456:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 216us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.679437:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00100000:3.0:1789601428.704157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601428.707394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307584 00000100:00100000:1.0:1789601428.707413:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307584 00000100:00100000:1.0:1789601428.707508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:1.0:1789601428.707520:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6719:x1876532898307584:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601428.734186:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6719:x1876532898307584:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 26653us (30031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601428.734205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:3.0:1789601428.744969:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601428.749183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307712 00000100:00100000:0.0:1789601428.749204:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307712 00000100:00100000:0.0:1789601428.749327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 257 00000100:00100000:0.0:1789601428.749340:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6719:x1876532898307712:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601428.749606:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:6719:x1876532898307712:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 218us (4603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601428.749617:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 257 00010000:00010000:2.0:1789601429.128536:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601429.297969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601429.298020:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601429.298055:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601429.298095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601429.298152:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308224 00000100:00100000:1.0:1789601429.298164:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308224 00000100:00100000:1.0:1789601429.298243:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308096 00000100:00100000:1.0:1789601429.298254:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308096 00000100:00100000:1.0:1789601429.298282:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:1.0:1789601429.298294:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898308224:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601429.298524:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898308224:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 231us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601429.298533:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:1.0:1789601429.298576:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789601429.298586:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898308096:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601429.298615:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898308096:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601429.298622:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1789601429.301789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307968 00000100:00100000:3.0:1789601429.301812:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307968 00000100:00100000:3.0:1789601429.301901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898307840 00000100:00100000:3.0:1789601429.301905:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898307840 00000100:00100000:3.0:1789601429.301952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:3.0:1789601429.301963:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898307968:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601429.302061:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898307968:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 99us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601429.302069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:3.0:1789601429.302089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:3.0:1789601429.302095:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898307840:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601429.302119:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898307840:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601429.302143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00080000:3.0:1789601429.302546:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601429.302551:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601429.302554:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601429.302592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1789601430.150011:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789601430.150022:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df501e60000 from 4 10000000:01000000:2.0:1789601430.150029:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601430.150091:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.150105:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.150118:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601430.150162:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.150266:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.150341:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.150854:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292480 00000100:00100000:1.0:1789601430.150864:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292480 00000100:00100000:1.0:1789601430.150931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789601430.150942:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918292480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.150958:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601430.150975:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f15f0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.151005:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.151018:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.151043:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601430.151107:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918292480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.151113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789601430.151848:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601430.151875:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.151887:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601430.151978:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.152025:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.152068:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00010000:00010000:1.0:1789601430.152511:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601430.152620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292608 00000100:00100000:0.0:1789601430.152652:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292608 00000100:00100000:0.0:1789601430.152711:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789601430.152721:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918292608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601430.152887:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918292608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601430.152895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789601430.162908:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.162987:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.163089:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.163134:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.164931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292736 00000100:00100000:1.0:1789601430.164961:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292736 00000100:00100000:1.0:1789601430.165031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789601430.165043:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918292736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.168823:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918292736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3766us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.168841:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789601430.170168:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918292736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601430.176893:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10428:1876532918292864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601430.177004:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601430.177058:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.177106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292864 00000100:00100000:1.0:1789601430.177115:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292864 00000100:00100000:1.0:1789601430.177175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789601430.177185:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10428:x1876532918292864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.177343:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10428:x1876532918292864:12345-0@lo:502:llog_process_th.0 Request processed in 159us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.177351:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789601430.180588:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10428:1876532918292864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601430.180676:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601430.180697:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601430.180700:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789601430.180709:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df501e60000 00000020:00000080:3.0:1789601430.180713:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789601430.180976:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10428:1876532918292992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601430.181074:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601430.181129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918292992 00000100:00100000:3.0:1789601430.181138:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918292992 00000100:00100000:3.0:1789601430.181195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789601430.185156:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10428:x1876532918292992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601430.185938:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601430.187961:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:10428:x1876532918292992:12345-0@lo:502:llog_process_th.0 Request processed in 6746us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601430.187978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789601430.197234:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10428:1876532918292992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601430.197310:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601430.197325:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601430.197342:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789601430.197347:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789601430.197930:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789601430.197958:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601430.197970:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.197984:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601430.197996:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601430.197999:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f70a3000 from 4 10000000:01000000:1.0:1789601430.198012:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601430.198057:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.198066:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.198075:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601430.198105:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.198210:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.198274:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.200105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293120 00000100:00100000:1.0:1789601430.200124:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293120 00000100:00100000:1.0:1789601430.200219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789601430.200231:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918293120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.200259:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601430.200280:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f15fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.200313:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.200325:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.200334:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef200, rc 0) 00000100:00100000:1.0:1789601430.200427:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.200445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789601430.200520:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.200541:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.200551:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601430.200890:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.200928:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.200972:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601430.201019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293248 00000100:00100000:2.0:1789601430.201026:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293248 00000100:00100000:2.0:1789601430.201063:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789601430.201072:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.201224:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.201231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789601430.202631:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.202692:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.202764:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.202803:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601430.202988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293376 00000100:00100000:2.0:1789601430.202998:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293376 00000100:00100000:2.0:1789601430.203045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789601430.203054:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.203192:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.203201:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789601430.205400:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.207876:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10430:1876532918293504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.207990:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.208051:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601430.208187:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293504 00000100:00100000:2.0:1789601430.208196:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293504 00000100:00100000:2.0:1789601430.208259:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789601430.208269:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10430:x1876532918293504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601430.208406:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10430:x1876532918293504:12345-0@lo:502:llog_process_th.0 Request processed in 138us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.208415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601430.208625:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10430:1876532918293504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.208657:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601430.208672:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.208674:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601430.208681:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4f70a3000 00000020:00000080:1.0:1789601430.208692:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601430.208789:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10430:1876532918293632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.208843:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.208872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293632 00000100:00100000:1.0:1789601430.208877:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293632 00000100:00100000:1.0:1789601430.208905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789601430.208912:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10430:x1876532918293632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.208981:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:10430:x1876532918293632:12345-0@lo:502:llog_process_th.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.208988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789601430.209020:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.209033:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10430:1876532918293632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.209051:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601430.209055:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.209057:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789601430.209061:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789601430.211417:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789601430.211458:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601430.211472:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.211500:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601430.211512:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789601430.211514:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f8b56000 from 4 10000000:01000000:2.0:1789601430.211517:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601430.211592:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.211601:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.212861:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601430.212903:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.212995:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.213043:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.213282:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293760 00000100:00100000:1.0:1789601430.213293:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293760 00000100:00100000:1.0:1789601430.213356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789601430.213368:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918293760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.213386:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601430.213405:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f160c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.213432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f160c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.213444:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f160c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.213461:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee200, rc 0) 00000100:00100000:1.0:1789601430.213512:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918293760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.213520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789601430.213602:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.213620:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.213630:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601430.213716:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.213751:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.213768:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.213784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918293888 00000100:00100000:1.0:1789601430.213788:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918293888 00000100:00100000:1.0:1789601430.213825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789601430.213834:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918293888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.213971:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918293888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.213978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789601430.214017:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918293888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.214048:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.214092:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.214117:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.214129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294016 00000100:00100000:1.0:1789601430.214132:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294016 00000100:00100000:1.0:1789601430.214152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789601430.214158:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918294016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.214254:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918294016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.214262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789601430.214309:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601430.217615:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10431:1876532918294144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601430.217719:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601430.217782:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.219885:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294144 00000100:00100000:1.0:1789601430.219905:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294144 00000100:00100000:1.0:1789601430.219985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789601430.219997:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10431:x1876532918294144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.221001:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10431:x1876532918294144:12345-0@lo:502:llog_process_th.0 Request processed in 1000us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.221014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789601430.221124:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10431:1876532918294144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.221211:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601430.221225:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.221228:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601430.221248:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4f8b56000 00000020:00000080:1.0:1789601430.221251:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601430.221363:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10431:1876532918294272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.221415:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.221448:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601430.221609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294272 00000100:00100000:2.0:1789601430.221617:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294272 00000100:00100000:2.0:1789601430.221662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789601430.221673:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10431:x1876532918294272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601430.221789:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:10431:x1876532918294272:12345-0@lo:502:llog_process_th.0 Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.221796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789601430.222792:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10431:1876532918294272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.223794:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601430.223807:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.223810:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789601430.224212:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789601430.225983:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789601430.226030:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601430.226046:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.226071:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601430.226086:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789601430.226090:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4d017d800 from 4 10000000:01000000:2.0:1789601430.226093:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601430.226142:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.226158:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601430.226171:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601430.226203:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601430.226303:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.226362:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.226918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294400 00000100:00100000:1.0:1789601430.226927:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294400 00000100:00100000:1.0:1789601430.226982:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789601430.226993:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918294400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.227010:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601430.227028:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f161a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.227056:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f161a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.227068:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f161a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.227076:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef600, rc 0) 00000100:00100000:1.0:1789601430.227133:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918294400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.227139:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789601430.227203:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601430.227219:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.227229:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601430.227325:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.227356:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.227378:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.227394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294528 00000100:00100000:1.0:1789601430.227398:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294528 00000100:00100000:1.0:1789601430.227422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789601430.227430:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918294528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.227586:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918294528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.227594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789601430.227653:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.227685:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.227739:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.227760:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.227777:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294656 00000100:00100000:1.0:1789601430.227780:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294656 00000100:00100000:1.0:1789601430.227807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789601430.230800:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918294656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601430.231433:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918294656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3616us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.231446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789601430.231783:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918294656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601430.237301:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10434:1876532918294784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601430.237414:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601430.237475:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f739b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.237640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294784 00000100:00100000:1.0:1789601430.237661:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294784 00000100:00100000:1.0:1789601430.237712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789601430.237738:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:10434:x1876532918294784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.238007:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:10434:x1876532918294784:12345-0@lo:502:llog_process_th.0 Request processed in 278us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.238016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789601430.240017:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10434:1876532918294784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.240078:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601430.240095:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.240098:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601430.240106:0:10434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4d017d800 00000020:00000080:1.0:1789601430.240110:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601430.240478:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10434:1876532918294912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.240585:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601430.241776:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918294912 00000100:00100000:1.0:1789601430.241786:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918294912 00000100:00100000:1.0:1789601430.241846:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789601430.241858:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:10434:x1876532918294912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601430.242025:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:10434:x1876532918294912:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601430.242033:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789601430.242097:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e14e60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601430.242121:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:10434:1876532918294912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601430.242157:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601430.242166:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601430.242169:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789601430.242173:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789601430.242271:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789601430.242301:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601430.242311:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601430.242323:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601430.352363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601430.352732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.352833:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295040 00000100:00100000:2.0:1789601430.352842:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295040 00000100:00100000:2.0:1789601430.352914:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601430.352926:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918295040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601430.352979:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601430.353032:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918295040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.353052:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789601430.353090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601430.353128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff502a00 x1876532918295040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601430.353148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601430.354526:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918295168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601430.354613:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601430.354685:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295168 00000100:00100000:3.0:1789601430.354693:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295168 00000100:00100000:3.0:1789601430.354753:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601430.354762:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918295168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601430.354785:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601430.354830:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918295168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601430.354838:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789601430.354861:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601430.354898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6a00 x1876532918295168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601430.354918:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918295168:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789601431.175848:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601431.878099:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918295296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601431.878176:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601431.878341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918295424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601431.878374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601431.878464:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295296 00000100:00100000:0.0:1789601431.878474:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295296 00000100:00100000:0.0:1789601431.878530:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295424 00000100:00100000:0.0:1789601431.878534:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295424 00000100:00100000:0.0:1789601431.878580:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789601431.878590:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918295296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789601431.878625:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601431.878690:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918295296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601431.878697:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789601431.878715:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789601431.878721:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918295424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601431.878732:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601431.878761:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918295424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601431.878781:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789601431.878820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8d880 x1876532918295424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601431.878839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918295424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789601431.879038:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601431.879114:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff502a00 x1876532918295296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601431.879128:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918295296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601431.879432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918295552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.879475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601431.879545:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601431.879552:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918295936:0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.879610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.880355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295936 00000100:00100000:3.0:1789601431.880362:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295936 00000100:00100000:3.0:1789601431.880413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789601431.880422:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.880472:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918295936:12345-0@lo:400:kworker.0 Request processed in 52us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601431.880490:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789601431.880528:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918295680:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.880582:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.880615:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918296192:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.880636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.880727:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918296704:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.880749:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.880768:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789601431.880775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918295808:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.880827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296064:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.880860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601431.880877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296576:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.880900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601431.880937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918295936:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.880953:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601431.880958:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918296448:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.880980:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601431.881028:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295680 00000100:00100000:2.0:1789601431.881033:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295680 00000100:00100000:2.0:1789601431.881061:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296192 00000100:00100000:2.0:1789601431.881064:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296192 00000100:00100000:2.0:1789601431.881083:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296704 00000100:00100000:2.0:1789601431.881086:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296704 00000100:00100000:2.0:1789601431.881100:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601431.881105:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.881153:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918295680:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601431.881160:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601431.881176:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601431.881182:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881285:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.881305:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918296320:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881327:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.881337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918296832:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601431.881392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918295680:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296320 00000100:00100000:3.0:1789601431.881414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296320 00000100:00100000:3.0:1789601431.881429:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296832 00000100:00100000:3.0:1789601431.881432:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296832 00000100:00100000:3.0:1789601431.881443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789601431.881448:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918296704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881482:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918296704:12345-0@lo:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601431.881487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789601431.881507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789601431.881512:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918296320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881541:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918296320:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601431.881546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789601431.881585:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789601431.881591:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.881618:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918296832:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601431.881624:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789601431.881754:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918296192:12345-0@lo:400:kworker.0 Request processed in 572us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601431.881760:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789601431.881778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601431.881781:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601431.882047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295552 00000100:00100000:0.0:1789601431.882056:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295552 00000100:00100000:0.0:1789601431.882099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789601431.882106:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918295552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601431.882153:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918295552:12345-0@lo:400:kworker.0 Request processed in 47us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601431.882160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789601431.882198:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296064 00000100:00100000:0.0:1789601431.882203:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296064 00000100:00100000:1.0:1789601431.882919:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296576 00000100:00100000:1.0:1789601431.882925:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296576 00000100:00100000:1.0:1789601431.882955:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296448 00000100:00100000:1.0:1789601431.882959:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296448 00000100:00100000:1.0:1789601431.882978:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601431.882986:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.883032:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296576:12345-0@lo:400:kworker.0 Request processed in 48us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601431.883039:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601431.883052:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601431.883058:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918296448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.883086:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918296448:12345-0@lo:400:kworker.0 Request processed in 29us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601431.883092:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789601431.883238:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2267100 x1876532918296448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601431.883253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918296448:0@lo:400:kworker.0 00010000:00080000:2.0:1789601431.883267:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a7800 x1876532918296576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601431.883275:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296576:0@lo:400:kworker.0 00000100:00100000:2.0:1789601431.883285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918295552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.886920:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918295808 00000100:00100000:1.0:1789601431.886938:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918295808 00000100:00100000:1.0:1789601431.887013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601431.887025:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.887121:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296064:12345-0@lo:400:kworker.0 Request processed in 99us (6259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601431.887129:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601431.887148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601431.887155:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601431.887185:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918295808:12345-0@lo:400:kworker.0 Request processed in 31us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601431.887203:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789601431.887362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296064:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.898393:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918295808:0@lo:400:kworker.0 00010000:00080000:3.0:1789601431.898419:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2264700 x1876532918296320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601431.898431:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918296320:0@lo:400:kworker.0 00010000:00080000:3.0:1789601431.898445:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6d80 x1876532918296832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601431.898454:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918296832:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.898467:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918296192:0@lo:400:kworker.0 00000100:00100000:3.0:1789601431.898478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918296704:0@lo:400:kworker.0 00010000:00010000:2.0:1789601432.198799:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601432.901764:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601432.901788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601432.901862:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601432.902024:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918296960 00000100:00100000:0.0:1789601432.902033:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918296960 00000100:00100000:0.0:1789601432.902090:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789601432.902099:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601432.902132:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601432.902192:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918296960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601432.902199:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789601432.902353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918296960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789601433.234538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601433.424042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918297088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601433.424118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601433.424280:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297088 00000100:00100000:0.0:1789601433.424290:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297088 00000100:00100000:0.0:1789601433.424361:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789601433.424372:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918297088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601433.424417:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601433.424490:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918297088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601433.424498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601433.424610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918297088:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601434.251322:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601434.420491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601434.420540:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601434.420674:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601434.420749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601434.420777:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308608 00000100:00100000:1.0:1789601434.420789:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308608 00000100:00100000:1.0:1789601434.420852:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308480 00000100:00100000:1.0:1789601434.420855:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308480 00000100:00100000:1.0:1789601434.420878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:1.0:1789601434.420889:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898308608:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601434.420965:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898308608:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601434.420972:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:1.0:1789601434.420989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1789601434.421004:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898308480:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601434.421028:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898308480:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601434.421035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00080000:1.0:1789601434.421053:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601434.421057:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601434.421220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308352 00000100:00100000:0.0:1789601434.421225:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308352 00000100:00100000:0.0:1789601434.421257:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:0.0:1789601434.421264:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898308352:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601434.421292:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898308352:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601434.421299:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:3.0:1789601434.423350:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308736 00000100:00100000:3.0:1789601434.423363:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308736 00000100:00100000:3.0:1789601434.423441:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789601434.423458:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898308736:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:3.0:1789601434.423495:0:8441:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1533 00000100:00080000:3.0:1789601434.423505:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601434.423551:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789601434.423722:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+2:2414:x1876532898308736:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 266us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601434.423730:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00010000:00010000:3.0:1789601434.423785:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789601434.424055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601434.432269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601434.432358:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308864 00000100:00100000:3.0:1789601434.432371:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308864 00000100:00100000:3.0:1789601434.432454:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789601434.432467:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898308864:12345-192.168.203.48@tcp:9:kworker.0 00000100:00080000:1.0:1789601434.432467:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789601434.432508:0:8857:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f153a 00000100:00080000:3.0:1789601434.432519:0:8857:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601434.432600:0:8857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1789601434.432617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601434.432785:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+2:2414:x1876532898308864:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 320us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601434.432794:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601434.891017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918297344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891176:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918297856:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891199:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918298368:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891259:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891289:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789601434.891295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918297216:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891326:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891353:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918297728:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297216 00000100:00100000:0.0:1789601434.891369:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297216 00000100:00100000:2.0:1789601434.891380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891402:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918298240:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891428:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789601434.891434:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601434.891443:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918297216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918298752:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891488:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601434.891510:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918297216:12345-0@lo:400:kworker.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.891532:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918297216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891535:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789601434.891589:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918297472:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891645:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918297984:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918298496:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891728:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891743:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789601434.891750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918297600:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891758:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297728 00000100:00100000:0.0:1789601434.891764:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297728 00000100:00100000:2.0:1789601434.891787:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601434.891792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297472 00000100:00100000:0.0:1789601434.891796:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297472 00000100:00100000:2.0:1789601434.891805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918298112:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891814:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789601434.891823:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918297728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891833:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601434.891860:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918298624:0@lo:400:kworker.0 00000100:00100000:0.0:1789601434.891872:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918297728:12345-0@lo:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601434.891880:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601434.891886:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601434.891909:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601434.891918:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918297472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.891925:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297344 00000100:00100000:2.0:1789601434.891932:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297344 00000100:00100000:2.0:1789601434.891959:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297856 00000100:00100000:0.0:1789601434.891959:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918297472:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.891965:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297856 00000100:00100000:0.0:1789601434.891969:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789601434.891991:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298368 00000100:00100000:2.0:1789601434.891995:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298368 00000100:00100000:2.0:1789601434.892005:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297984 00000100:00100000:2.0:1789601434.892007:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297984 00000100:00100000:2.0:1789601434.892016:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298496 00000100:00100000:2.0:1789601434.892018:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298496 00000100:00100000:2.0:1789601434.892026:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918297600 00000100:00100000:2.0:1789601434.892028:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918297600 00000100:00100000:2.0:1789601434.892038:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789601434.892044:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918297344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892077:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918297344:12345-0@lo:400:kworker.0 Request processed in 33us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892083:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789601434.892097:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789601434.892102:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918297856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892129:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918297856:12345-0@lo:400:kworker.0 Request processed in 26us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892135:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789601434.892144:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789601434.892156:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892182:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918298368:12345-0@lo:400:kworker.0 Request processed in 27us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892188:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789601434.892198:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789601434.892217:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918297984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892245:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918297984:12345-0@lo:400:kworker.0 Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892250:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789601434.892261:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601434.892267:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918298496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892292:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918298496:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892297:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601434.892308:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789601434.892314:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918297600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892339:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918297600:12345-0@lo:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892345:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789601434.892373:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298240 00000100:00100000:2.0:1789601434.892377:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298240 00000100:00100000:2.0:1789601434.892395:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298752 00000100:00100000:2.0:1789601434.892398:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298752 00000100:00100000:2.0:1789601434.892409:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298112 00000100:00100000:2.0:1789601434.892411:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298112 00000100:00100000:2.0:1789601434.892422:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298624 00000100:00100000:2.0:1789601434.892424:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298624 00000100:00100000:2.0:1789601434.892448:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601434.892454:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918298240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892486:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918298240:12345-0@lo:400:kworker.0 Request processed in 32us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892492:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601434.892504:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601434.892510:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f776e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918298752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892539:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f776e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918298752:12345-0@lo:400:kworker.0 Request processed in 29us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892544:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601434.892705:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601434.892712:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918298112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892741:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918298112:12345-0@lo:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892748:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601434.892760:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601434.892766:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892791:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918298624:12345-0@lo:400:kworker.0 Request processed in 25us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601434.892797:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601434.892847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918297600:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.892861:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2808a80 x1876532918298112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.892871:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918298112:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.892881:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3436a00 x1876532918298624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.892897:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918298624:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892909:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918297472:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.892918:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2809180 x1876532918297984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.892926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918297984:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.892935:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3436d80 x1876532918298496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.892943:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918298496:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.892974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918297728:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.892983:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3436300 x1876532918298240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.892991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918298240:0@lo:400:kworker.0 00010000:00080000:2.0:1789601434.893000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3aa00 x1876532918298752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601434.893008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918298752:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.893018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918297344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.893027:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918297856:0@lo:400:kworker.0 00000100:00100000:2.0:1789601434.893035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918298368:0@lo:400:kworker.0 00000100:00080000:1.0:1789601434.894547:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601434.894568:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601434.894572:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601434.894575:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789601435.270699:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601435.461690:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601435.461720:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918298880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601435.461806:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601435.469871:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918298880 00000100:00100000:2.0:1789601435.469889:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918298880 00000100:00100000:2.0:1789601435.469962:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789601435.469973:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918298880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601435.470009:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601435.470090:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918298880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (8283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601435.470097:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789601435.470144:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92d80 x1876532918298880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601435.470166:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918298880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601435.470652:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601435.470666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918299008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601435.470707:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601435.470741:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299008 00000100:00100000:0.0:1789601435.470745:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299008 00000100:00100000:0.0:1789601435.470785:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601435.470791:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918299008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601435.470803:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601435.470836:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918299008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601435.470841:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789601435.470871:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8f800 x1876532918299008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601435.470884:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918299008:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1789601436.221963:0:10699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789601436.293682:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601436.997829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601436.997900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601436.998062:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299136 00000100:00100000:0.0:1789601436.998073:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299136 00000100:00100000:0.0:1789601436.998146:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601436.998156:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918299136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601436.998184:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601436.998256:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918299136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601436.998277:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789601436.998318:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8f800 x1876532918299136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789601436.998334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601436.998340:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601436.998510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918299264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601436.998540:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601436.998579:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299264 00000100:00100000:3.0:1789601436.998584:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299264 00000100:00080000:1.0:1789601436.998622:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601436.998626:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789601436.998633:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918299264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601436.998650:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601437.001890:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918299264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3247us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601437.001904:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789601437.002332:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc90a80 x1876532918299264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601437.002504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918299264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789601437.323338:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601438.021839:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601438.025193:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918299392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601438.025319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601438.025863:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299392 00000100:00100000:0.0:1789601438.025876:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299392 00000100:00100000:0.0:1789601438.025950:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789601438.025962:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918299392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601438.026010:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601438.026089:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918299392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601438.026096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789601438.027554:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918299392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601438.343790:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601438.535388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918299520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601438.536684:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601438.537267:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299520 00000100:00100000:0.0:1789601438.537279:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299520 00000100:00100000:0.0:1789601438.537345:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789601438.537357:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918299520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601438.537403:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601438.537589:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918299520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 234us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601438.537597:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601438.537702:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918299520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601439.366402:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601439.523805:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601439.523842:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601439.523886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601439.523928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309248 00000100:00100000:3.0:1789601439.523939:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309248 00000100:00100000:0.0:1789601439.524189:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898308992 00000100:00100000:0.0:1789601439.524195:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898308992 00000100:00100000:1.0:1789601439.524218:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309120 00000100:00100000:1.0:1789601439.524225:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309120 00000100:00100000:3.0:1789601439.524307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:3.0:1789601439.524319:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898309248:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601439.524409:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898309248:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 92us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601439.524417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:0.0:1789601439.524772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00100000:0.0:1789601439.524781:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2417:x1876532898308992:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601439.524817:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2417:x1876532898308992:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601439.524840:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00100000:1.0:1789601439.530477:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:1.0:1789601439.530502:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898309120:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601439.530798:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898309120:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 306us (6910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601439.530807:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00080000:0.0:1789601439.533315:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601439.533766:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601440.081436:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918299648:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081543:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081645:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918300160:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081679:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918300672:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081726:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081745:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918301184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081766:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081787:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789601440.081792:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918300032:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081818:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081848:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918300544:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081871:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081889:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918301056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081943:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918299904:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.081967:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.081988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918300416:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082009:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.082025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918300928:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.082062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789601440.082067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918299776:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082090:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.082108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918300288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082130:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.082140:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918300800:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601440.082201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299648 00000100:00100000:3.0:1789601440.082212:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299648 00000100:00100000:3.0:1789601440.082287:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789601440.082297:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918299648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082355:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918299648:12345-0@lo:400:kworker.0 Request processed in 60us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789601440.082407:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300160 00000100:00100000:3.0:1789601440.082419:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300160 00000100:00100000:3.0:1789601440.082448:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299904 00000100:00100000:3.0:1789601440.082451:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299904 00000100:00100000:3.0:1789601440.082467:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601440.082473:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918300160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082515:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918300160:12345-0@lo:400:kworker.0 Request processed in 42us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601440.082533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789601440.082539:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918299904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082607:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918299904:12345-0@lo:400:kworker.0 Request processed in 69us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082614:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789601440.082636:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300672 00000100:00100000:3.0:1789601440.082640:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300672 00000100:00100000:3.0:1789601440.082680:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301184 00000100:00100000:3.0:1789601440.082683:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301184 00000100:00100000:3.0:1789601440.082703:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300544 00000100:00100000:3.0:1789601440.082706:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300544 00000100:00100000:3.0:1789601440.082723:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301056 00000100:00100000:3.0:1789601440.082726:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301056 00000100:00100000:3.0:1789601440.082745:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601440.082753:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918300672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082794:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918300672:12345-0@lo:400:kworker.0 Request processed in 42us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082800:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601440.082814:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789601440.082821:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082863:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918301184:12345-0@lo:400:kworker.0 Request processed in 43us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082871:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789601440.082885:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789601440.082891:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082922:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918300544:12345-0@lo:400:kworker.0 Request processed in 31us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082928:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789601440.082942:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789601440.082947:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.082978:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918301056:12345-0@lo:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.082984:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789601440.083013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300032 00000100:00100000:3.0:1789601440.083017:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300032 00000100:00100000:3.0:1789601440.083039:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300416 00000100:00100000:3.0:1789601440.083042:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300416 00000100:00100000:3.0:1789601440.083061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300928 00000100:00100000:3.0:1789601440.083064:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300928 00000100:00100000:3.0:1789601440.083076:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918299776 00000100:00100000:3.0:1789601440.083079:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918299776 00000100:00100000:3.0:1789601440.083089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300288 00000100:00100000:3.0:1789601440.083092:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300288 00000100:00100000:3.0:1789601440.083103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918300800 00000100:00100000:3.0:1789601440.083105:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918300800 00000100:00100000:3.0:1789601440.083120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789601440.083127:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918300032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083160:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918300032:12345-0@lo:400:kworker.0 Request processed in 33us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083186:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789601440.083201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789601440.083207:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083240:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918300416:12345-0@lo:400:kworker.0 Request processed in 33us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789601440.083256:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789601440.083262:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918300928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083288:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918300928:12345-0@lo:400:kworker.0 Request processed in 26us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083292:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789601440.083303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789601440.083307:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083332:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918299776:12345-0@lo:400:kworker.0 Request processed in 24us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789601440.083347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789601440.083352:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918300288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083377:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918300288:12345-0@lo:400:kworker.0 Request processed in 26us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083383:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789601440.083393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789601440.083399:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918300800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083424:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918300800:12345-0@lo:400:kworker.0 Request processed in 26us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601440.083437:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1789601440.083491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601440.083495:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601440.083499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601440.083501:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601440.083539:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918299776:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083553:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918300288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918300800:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083604:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918299904:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8e680 x1876532918300416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083629:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918300416:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083639:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8c700 x1876532918300928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918300928:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083694:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918300032:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8c380 x1876532918300544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083715:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918300544:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083727:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2a00 x1876532918301056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083734:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918301056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083755:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918300160:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083767:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8dc00 x1876532918300672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918300672:0@lo:400:kworker.0 00010000:00080000:3.0:1789601440.083785:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e1500 x1876532918301184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.083792:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918301184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601440.083802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918299648:0@lo:400:kworker.0 00000001:00100000:0.0:1789601440.084221:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:0.0:1789601440.084227:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df3c2af9800/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:1.0:1789601440.084259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2af9800/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-OST0001 00000020:00000080:1.0:1789601440.084340:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2b0e000 for lustre-OST0001 00000001:00100000:2.0:1789601440.095435:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:2.0:1789601440.095449:0:8434:0:(genops.c:885:class_export_put()) final put ffff8df3c19ce000/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:3.0:1789601440.096078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c19ce000/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-OST0000 00000020:00000080:3.0:1789601440.096147:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c19cb800 for lustre-OST0000 00010000:00010000:0.0:1789601440.392000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601440.583888:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918301312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601440.583982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601440.584078:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301312 00000100:00100000:2.0:1789601440.586326:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301312 00000100:00100000:2.0:1789601440.586424:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601440.586437:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918301312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601440.586476:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601440.586595:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918301312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.586603:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789601440.586671:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc93b80 x1876532918301312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601440.586693:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918301312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601440.588804:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601440.588832:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918301440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601440.589016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601440.589053:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301440 00000100:00100000:2.0:1789601440.589063:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301440 00000100:00100000:2.0:1789601440.589115:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601440.589125:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918301440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601440.589151:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789601440.596973:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e3b80 x1876532918301440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601440.597011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918301440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601440.599077:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918301440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7270us (7379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.599096:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1789601441.415103:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601442.120646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601442.120666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918301568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601442.120753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601442.120825:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301568 00000100:00100000:0.0:1789601442.120833:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301568 00000100:00100000:0.0:1789601442.120884:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789601442.120894:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918301568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601442.120922:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601442.120964:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918301568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601442.120972:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789601442.120992:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601442.121021:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e3b80 x1876532918301568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601442.121057:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918301568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601442.121384:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918301696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601442.121413:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601442.121531:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301696 00000100:00100000:2.0:1789601442.121536:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301696 00000100:00100000:2.0:1789601442.121599:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601442.121606:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918301696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601442.121618:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601442.121652:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918301696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601442.121667:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789601442.121698:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc93b80 x1876532918301696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601442.121710:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918301696:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789601442.121764:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789601442.439702:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601442.445737:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing yml_node 00000100:00100000:1.0:1789601443.144892:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918301824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601443.144997:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601443.145107:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301824 00000100:00100000:3.0:1789601443.145116:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301824 00000100:00100000:3.0:1789601443.145178:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789601443.145188:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918301824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601443.146352:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601443.156442:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918301824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11244us (11434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601443.156456:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789601443.159531:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918301824:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601443.473971:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601443.656612:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601443.656634:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918301952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601443.656734:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601443.656794:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918301952 00000100:00100000:3.0:1789601443.656801:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918301952 00000100:00100000:3.0:1789601443.656843:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789601443.656859:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918301952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601443.656917:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789601443.656962:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918301952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601443.656969:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789601443.657013:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918301952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601444.488277:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601444.640877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601444.640940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601444.640993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601444.641110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309632 00000100:00100000:0.0:1789601444.641123:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309632 00000100:00100000:0.0:1789601444.641210:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309504 00000100:00100000:0.0:1789601444.641214:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309504 00000100:00100000:0.0:1789601444.641245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:0.0:1789601444.641258:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898309632:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601444.641357:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898309632:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601444.641375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:0.0:1789601444.641400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:0.0:1789601444.641409:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898309504:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601444.641450:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898309504:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601444.641460:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:3.0:1789601444.641740:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309376 00000100:00100000:3.0:1789601444.641747:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309376 00000100:00100000:3.0:1789601444.641790:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 283 00000100:00100000:3.0:1789601444.641801:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2415:x1876532898309376:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601444.641853:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2415:x1876532898309376:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 53us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601444.641863:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 283 00000100:00080000:1.0:1789601444.642062:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601444.642228:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601445.190500:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918302208:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.190609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.190666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918302720:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.190689:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.190709:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918303232:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.190728:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.190756:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789601445.190765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918302080:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.190801:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.190827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918302592:0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.190850:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918302464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.190865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.190894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.191027:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918302336:0@lo:400:kworker.0 00000100:00100000:0.0:1789601445.191113:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302208 00000100:00100000:0.0:1789601445.191121:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302208 00000100:00100000:0.0:1789601445.191178:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302720 00000100:00100000:0.0:1789601445.191182:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302720 00000100:00100000:0.0:1789601445.191205:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303232 00000100:00100000:0.0:1789601445.191208:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303232 00000100:00100000:0.0:1789601445.191245:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789601445.191254:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918302208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.191324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.191346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918303616:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.191369:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601445.191399:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303104 00000100:00100000:2.0:1789601445.191403:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303104 00000100:00100000:2.0:1789601445.191431:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303616 00000100:00100000:2.0:1789601445.191440:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303616 00000100:00100000:2.0:1789601445.191464:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601445.191470:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918303104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.193030:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918303104:12345-0@lo:400:kworker.0 Request processed in 1552us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.193043:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601445.193078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789601445.193090:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918303616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.193122:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918303616:12345-0@lo:400:kworker.0 Request processed in 37us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.193127:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789601445.194020:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789601445.194032:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918302720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194083:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918302720:12345-0@lo:400:kworker.0 Request processed in 55us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.194089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789601445.194105:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789601445.194112:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918303232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194150:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918303232:12345-0@lo:400:kworker.0 Request processed in 39us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.194155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1789601445.194346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0bb800 x1876532918303104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601445.194365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918303104:0@lo:400:kworker.0 00010000:00080000:2.0:1789601445.194383:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280a680 x1876532918303616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601445.194417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918303616:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194432:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918302720:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194442:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918303232:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194496:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302592 00000100:00100000:2.0:1789601445.194503:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302592 00000100:00100000:2.0:1789601445.194539:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601445.194546:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918302592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194610:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918302592:12345-0@lo:400:kworker.0 Request processed in 64us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.194616:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601445.194638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302080 00000100:00100000:2.0:1789601445.194642:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302080 00000100:00100000:2.0:1789601445.194666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789601445.194673:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918302080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194704:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918302080:12345-0@lo:400:kworker.0 Request processed in 32us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.194711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789601445.194751:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918302080:0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.194763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918302592:0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.196183:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601445.196269:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918302976:0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.196338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601445.196371:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918303488:0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.196395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601445.196459:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302976 00000100:00100000:1.0:1789601445.196468:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302976 00000100:00100000:2.0:1789601445.196779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302464 00000100:00100000:2.0:1789601445.196784:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302464 00000100:00100000:2.0:1789601445.196826:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789601445.196835:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918302464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.199151:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918302464:12345-0@lo:400:kworker.0 Request processed in 2185us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.199168:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789601445.199269:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303488 00000100:00100000:2.0:1789601445.199278:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303488 00000100:00100000:2.0:1789601445.199338:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789601445.199349:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918302976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.199426:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918302976:12345-0@lo:400:kworker.0 Request processed in 80us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.199432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789601445.199447:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601445.199454:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918303488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601445.199486:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918303488:12345-0@lo:400:kworker.0 Request processed in 33us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.199491:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789601445.199655:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601445.199662:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601445.199666:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601445.206418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918302464:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789601445.206451:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0bb480 x1876532918302976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601445.206464:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918302976:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206515:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302336 00000100:00100000:3.0:1789601445.206526:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302336 00000100:00100000:3.0:1789601445.206592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789601445.206602:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918302336:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789601445.206656:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2808a80 x1876532918303488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601445.206668:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918302336:12345-0@lo:400:kworker.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601445.206674:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918303488:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206686:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789601445.206767:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918302336:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206780:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918302848:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601445.206877:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918303360:0@lo:400:kworker.0 00000100:00100000:3.0:1789601445.206906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601445.206997:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918302848 00000100:00100000:1.0:1789601445.207005:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918302848 00000100:00100000:1.0:1789601445.207149:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303360 00000100:00100000:1.0:1789601445.207154:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303360 00000100:00100000:1.0:1789601445.207176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601445.207185:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918302848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.207261:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918302848:12345-0@lo:400:kworker.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601445.207269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601445.207285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789601445.207291:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601445.207320:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918303360:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601445.207326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789601445.207349:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789601445.207874:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2809180 x1876532918303360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601445.207890:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918303360:0@lo:400:kworker.0 00010000:00080000:2.0:1789601445.208008:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0b9880 x1876532918302848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601445.208017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918302848:0@lo:400:kworker.0 00000100:00100000:0.0:1789601445.208714:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918302208:12345-0@lo:400:kworker.0 Request processed in 17452us (18096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601445.208726:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789601445.208928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918302208:0@lo:400:kworker.0 00010000:00010000:2.0:1789601445.509782:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601445.701778:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918303872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601445.701844:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601445.701858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918303744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601445.701917:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601445.702042:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303744 00000100:00100000:0.0:1789601445.702050:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303744 00000100:00100000:0.0:1789601445.702096:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601445.702104:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918303744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601445.702150:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601445.702194:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918303744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601445.702202:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789601445.702237:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23ff100 x1876532918303744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601445.702253:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918303744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601445.703162:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601445.703687:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918303872 00000100:00100000:0.0:1789601445.703697:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918303872 00000100:00100000:0.0:1789601445.703750:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601445.703759:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918303872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601445.703779:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601445.703846:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918303872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601445.703853:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789601445.711390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2680 x1876532918303872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601445.711419:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918303872:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601446.539287:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601446.945209:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:2.0:1789601447.237707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601447.237742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918304000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601447.237812:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.237891:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304000 00000100:00100000:3.0:1789601447.237899:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304000 00000100:00100000:3.0:1789601447.237975:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601447.237995:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918304000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601447.238023:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601447.238079:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918304000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.238085:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789601447.238159:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c23ff100 x1876532918304000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601447.238175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918304000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789601447.238375:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601447.244104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601447.244137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918304128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601447.244203:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601447.244270:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304128 00000100:00100000:2.0:1789601447.244280:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304128 00000100:00100000:2.0:1789601447.244341:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601447.244350:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918304128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601447.244370:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601447.244416:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918304128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601447.244423:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789601447.244469:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc90a80 x1876532918304128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601447.244487:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918304128:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789601447.244596:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789601447.557828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601448.261966:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601448.261990:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918304256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601448.262058:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601448.262281:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304256 00000100:00100000:3.0:1789601448.262290:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304256 00000100:00100000:3.0:1789601448.262340:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789601448.262349:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918304256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601448.262383:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601448.262457:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918304256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601448.262465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601448.262588:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918304256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789601448.581860:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601448.774126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601448.774157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918304384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601448.774230:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601448.774547:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304384 00000100:00100000:3.0:1789601448.774581:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304384 00000100:00100000:3.0:1789601448.775897:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789601448.775914:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918304384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601448.775967:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789601448.776151:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918304384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601448.776160:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789601448.776263:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918304384:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601449.605720:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601449.762765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601449.762840:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309888 00000100:00100000:1.0:1789601449.762851:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309888 00000100:00100000:1.0:1789601449.762923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:1.0:1789601449.762934:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898309888:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601449.763004:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898309888:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601449.763012:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00080000:3.0:1789601449.763157:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601449.774262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601449.774313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601449.774416:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310016 00000100:00100000:1.0:1789601449.774427:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310016 00000100:00100000:1.0:1789601449.774491:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:1.0:1789601449.774502:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898310016:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601449.774593:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898310016:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601449.774600:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00080000:1.0:1789601449.774625:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601449.774897:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898309760 00000100:00100000:3.0:1789601449.774902:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898309760 00000100:00100000:3.0:1789601449.774930:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 285 00000100:00100000:3.0:1789601449.774938:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898309760:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601449.774976:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2416:x1876532898309760:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601449.774983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 285 00000001:02000400:0.0:1789601450.163171:0:11224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:0.0:1789601450.309894:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918304896:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.309965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918305408:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.310062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310087:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918305920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.310122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310149:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789601450.310155:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918304512:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.310181:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310204:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918305024:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.310225:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918305536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.310262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.310274:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918306048:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310381:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918304640:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310407:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310451:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918305664:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310465:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310477:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789601450.310482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918304768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310510:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918305280:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918305792:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601450.310601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304896 00000100:00100000:1.0:1789601450.310617:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304896 00000100:00100000:1.0:1789601450.310649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304640 00000100:00100000:1.0:1789601450.310651:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304640 00000100:00100000:1.0:1789601450.310659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305152 00000100:00100000:1.0:1789601450.310661:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305152 00000100:00100000:1.0:1789601450.310678:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305664 00000100:00100000:1.0:1789601450.310680:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305664 00000100:00100000:1.0:1789601450.310689:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305280 00000100:00100000:1.0:1789601450.310691:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305280 00000100:00100000:1.0:1789601450.310701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305792 00000100:00100000:1.0:1789601450.310702:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305792 00000100:00100000:1.0:1789601450.310715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601450.310722:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310763:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918304896:12345-0@lo:400:kworker.0 Request processed in 41us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601450.310782:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601450.310788:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310814:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918304640:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310820:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601450.310829:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601450.310834:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918305152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310853:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918305152:12345-0@lo:400:kworker.0 Request processed in 20us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601450.310873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601450.310878:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310899:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918305664:12345-0@lo:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601450.310912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601450.310916:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918305280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310934:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918305280:12345-0@lo:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601450.310947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601450.310952:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918305792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.310969:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918305792:12345-0@lo:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.310974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601450.310996:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305024 00000100:00100000:1.0:1789601450.310999:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305024 00000100:00100000:1.0:1789601450.311018:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304768 00000100:00100000:1.0:1789601450.311020:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304768 00000100:00100000:1.0:1789601450.311029:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789601450.311034:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918305024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311059:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918305024:12345-0@lo:400:kworker.0 Request processed in 25us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.311065:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789601450.311080:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601450.311084:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918304768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311122:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918304768:12345-0@lo:400:kworker.0 Request processed in 37us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.311128:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789601450.311142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601450.311145:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601450.311168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918304768:0@lo:400:kworker.0 00010000:00080000:1.0:1789601450.311179:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2300 x1876532918305280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601450.311190:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918305280:0@lo:400:kworker.0 00010000:00080000:1.0:1789601450.311198:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2680 x1876532918305792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601450.311205:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918305792:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918304640:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311219:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311227:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918305664:0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311268:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918304512 00000100:00100000:1.0:1789601450.311271:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918304512 00000100:00100000:1.0:1789601450.311303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789601450.311309:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918304512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601450.311335:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918304512:12345-0@lo:400:kworker.0 Request processed in 27us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601450.311348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789601450.311586:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305408 00000100:00100000:2.0:1789601450.311590:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305408 00000100:00100000:2.0:1789601450.311626:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305920 00000100:00100000:2.0:1789601450.311629:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305920 00000100:00100000:2.0:1789601450.311646:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918305536 00000100:00100000:2.0:1789601450.311648:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918305536 00000100:00100000:2.0:1789601450.311659:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601450.311665:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918305408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601450.311697:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918305408:12345-0@lo:400:kworker.0 Request processed in 32us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.311702:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601450.311713:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601450.311718:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918305920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601450.311737:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918305920:12345-0@lo:400:kworker.0 Request processed in 20us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.311742:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601450.311750:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601450.311755:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918305536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601450.311772:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918305536:12345-0@lo:400:kworker.0 Request processed in 18us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.311778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789601450.312372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601450.312377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601450.312596:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.312825:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918304896:0@lo:400:kworker.0 00010000:00080000:0.0:1789601450.312837:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e1c00 x1876532918305408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.312846:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918305408:0@lo:400:kworker.0 00010000:00080000:0.0:1789601450.312866:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e0700 x1876532918305920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.312874:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918305920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.312893:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918304512:0@lo:400:kworker.0 00000100:00100000:0.0:1789601450.312902:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918305024:0@lo:400:kworker.0 00010000:00080000:0.0:1789601450.312910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e0380 x1876532918305536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.312917:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918305536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601450.312977:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306048 00000100:00100000:2.0:1789601450.312983:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306048 00000100:00100000:2.0:1789601450.313024:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789601450.313031:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918306048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601450.313068:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918306048:12345-0@lo:400:kworker.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.313073:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789601450.313146:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e1500 x1876532918306048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.313154:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918306048:0@lo:400:kworker.0 00000100:00080000:1.0:1789601450.313206:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789601450.629779:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601450.822024:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601450.822046:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918306176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601450.822121:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601450.822181:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306176 00000100:00100000:0.0:1789601450.822189:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306176 00000100:00100000:0.0:1789601450.822233:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601450.822241:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918306176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601450.822268:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601450.822309:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918306176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601450.822315:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789601450.822353:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3482300 x1876532918306176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.822378:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918306176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601450.822713:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601450.822740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601450.822815:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306304 00000100:00100000:2.0:1789601450.822820:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306304 00000100:00100000:2.0:1789601450.822861:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789601450.822868:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918306304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601450.822879:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601450.824353:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918306304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1479us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.824365:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789601450.825848:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc93b80 x1876532918306304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601450.825875:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918306304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601451.658203:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601452.357845:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918306560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601452.357958:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601452.358040:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601452.358048:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918306432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601452.358076:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601452.358126:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306560 00000100:00100000:1.0:1789601452.358135:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306560 00000100:00100000:2.0:1789601452.358309:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306432 00000100:00100000:2.0:1789601452.358314:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306432 00000100:00100000:1.0:1789601452.358385:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789601452.359063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601452.360359:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918306560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601452.360408:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601452.361116:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918306560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2715us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601452.361127:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789601452.361481:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789601452.361590:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918306432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601452.361613:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601452.361670:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918306432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601452.361677:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789601452.362378:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc93b80 x1876532918306432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601452.362411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918306432:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789601452.362428:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a97480 x1876532918306560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601452.362493:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918306560:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789601452.678550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601453.162038:0:11321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:3.0:1789601453.383978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601453.384021:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918306688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601453.384126:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601453.384287:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306688 00000100:00100000:1.0:1789601453.384299:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306688 00000100:00100000:1.0:1789601453.384370:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601453.384399:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918306688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601453.384444:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601453.384509:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918306688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601453.384517:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601453.384608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918306688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789601453.701952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601453.895363:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601453.895396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918306816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601453.895511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601453.896047:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306816 00000100:00100000:0.0:1789601453.896059:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306816 00000100:00100000:0.0:1789601453.896143:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601453.896294:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918306816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601453.896345:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601453.896422:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918306816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 269us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601453.896430:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789601453.896526:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918306816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601454.725745:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601454.880969:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601454.881016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601454.881048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601454.881191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310144 00000100:00100000:1.0:1789601454.881207:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310144 00000100:00100000:1.0:1789601454.881279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 287 00000100:00100000:1.0:1789601454.881293:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898310144:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601454.881390:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898310144:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 100us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601454.881399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 287 00000100:00100000:1.0:1789601454.881442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310400 00000100:00100000:1.0:1789601454.881446:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310400 00000100:00100000:1.0:1789601454.881486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310272 00000100:00100000:1.0:1789601454.881489:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310272 00000100:00100000:1.0:1789601454.881515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:1.0:1789601454.881522:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898310400:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601454.881603:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898310400:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 80us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601454.881610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:1.0:1789601454.881625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:1.0:1789601454.881633:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898310272:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601454.881661:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898310272:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601454.881688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00080000:1.0:1789601454.881860:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601454.881865:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1789601455.079395:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 19:30:53 EDT 2026 00000100:00100000:2.0:1789601455.430012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918307328:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430092:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430151:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918307840:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430201:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918308352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430221:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430251:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789601455.430257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918307200:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430294:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430314:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918307712:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430351:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918308224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430388:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601455.430419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307328 00000100:00100000:2.0:1789601455.430428:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307328 00000100:00100000:2.0:1789601455.430484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307712 00000100:00100000:2.0:1789601455.430487:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307712 00000100:00100000:2.0:1789601455.430509:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308224 00000100:00100000:2.0:1789601455.430512:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308224 00000100:00100000:2.0:1789601455.430528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789601455.430536:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918307328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430616:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918307328:12345-0@lo:400:kworker.0 Request processed in 80us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430623:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789601455.430640:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789601455.430646:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918307712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430668:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918307712:12345-0@lo:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789601455.430682:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789601455.430687:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918308224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430708:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918308224:12345-0@lo:400:kworker.0 Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430713:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789601455.430729:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307840 00000100:00100000:2.0:1789601455.430731:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307840 00000100:00100000:2.0:1789601455.430765:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308352 00000100:00100000:2.0:1789601455.430768:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308352 00000100:00100000:2.0:1789601455.430787:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601455.430792:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918307840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430828:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918307840:12345-0@lo:400:kworker.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430833:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601455.430851:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789601455.430857:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918308352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430882:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918308352:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430888:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789601455.430909:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307200 00000100:00100000:2.0:1789601455.430912:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307200 00000100:00100000:2.0:1789601455.430936:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789601455.430942:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918307200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.430973:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918307200:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.430978:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789601455.431000:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601455.431004:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601455.431006:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601455.431035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918307200:0@lo:400:kworker.0 00010000:00080000:2.0:1789601455.431045:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0bb480 x1876532918307712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601455.431066:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918307712:0@lo:400:kworker.0 00010000:00080000:2.0:1789601455.431076:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3aa00 x1876532918308224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601455.431084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918308224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.431104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918307328:0@lo:400:kworker.0 00010000:00080000:2.0:1789601455.431113:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0b8e00 x1876532918307840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601455.431120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918307840:0@lo:400:kworker.0 00010000:00080000:2.0:1789601455.431129:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a39880 x1876532918308352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601455.431137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918308352:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918306944:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431485:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431516:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918307456:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431539:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431579:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918307968:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431601:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431617:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918308480:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431648:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431669:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789601455.431676:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918307072:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431715:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918307584:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431733:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431747:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918308096:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431764:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.431789:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307968 00000100:00100000:0.0:1789601455.431794:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307968 00000100:00100000:0.0:1789601455.431828:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308480 00000100:00100000:0.0:1789601455.431832:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308480 00000100:00100000:0.0:1789601455.431848:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789601455.431855:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918307968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431893:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918307968:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.431899:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789601455.431911:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601455.431917:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918308480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.431941:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918308480:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.431947:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601455.431964:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307456 00000100:00100000:0.0:1789601455.431967:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307456 00000100:00100000:0.0:1789601455.431991:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601455.431997:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432033:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918307456:12345-0@lo:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.432040:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601455.432069:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307072 00000100:00100000:0.0:1789601455.432073:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307072 00000100:00100000:0.0:1789601455.432094:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918307584 00000100:00100000:0.0:1789601455.432096:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918307584 00000100:00100000:0.0:1789601455.432108:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308096 00000100:00100000:0.0:1789601455.432110:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308096 00000100:00100000:0.0:1789601455.432125:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789601455.432139:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918307072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432168:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918307072:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.432173:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789601455.432185:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789601455.432190:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918307584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432216:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918307584:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.432222:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789601455.432233:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789601455.432239:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918308096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432263:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918308096:12345-0@lo:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.432269:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1789601455.432293:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601455.432297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601455.432299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601455.432339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918307072:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432349:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918307584:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432357:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918308096:0@lo:400:kworker.0 00000100:00100000:0.0:1789601455.432365:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918307456:0@lo:400:kworker.0 00010000:00080000:0.0:1789601455.432375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0bad80 x1876532918307968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601455.432384:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918307968:0@lo:400:kworker.0 00010000:00080000:0.0:1789601455.432393:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3b480 x1876532918308480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601455.432400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918308480:0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.433313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918306944 00000100:00100000:2.0:1789601455.433323:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918306944 00000100:00100000:2.0:1789601455.433449:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789601455.433469:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918306944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601455.433543:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918306944:12345-0@lo:400:kworker.0 Request processed in 86us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601455.433549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789601455.434073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918306944:0@lo:400:kworker.0 00010000:00010000:3.0:1789601455.750551:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601455.941829:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918308608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601455.941927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601455.942031:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308608 00000100:00100000:0.0:1789601455.942041:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308608 00000100:00100000:0.0:1789601455.942115:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601455.942126:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918308608:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601455.942264:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918308736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601455.942298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789601455.942498:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789601455.942713:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3480700 x1876532918308608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601455.942739:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918308608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601455.942846:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918308608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 721us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.942856:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601455.942877:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308736 00000100:00100000:0.0:1789601455.942881:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308736 00000100:00100000:0.0:1789601455.942918:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601455.942924:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918308736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601455.942935:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601455.943307:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918308736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 381us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601455.943314:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789601455.945838:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2266a00 x1876532918308736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601455.945872:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918308736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601456.778074:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601457.477713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601457.477743:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601457.477842:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601457.477940:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308864 00000100:00100000:3.0:1789601457.477950:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308864 00000100:00100000:3.0:1789601457.478018:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789601457.478031:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918308864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601457.478079:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601457.478130:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918308864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601457.478138:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789601457.478161:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601457.478204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8d180 x1876532918308864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601457.478226:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601457.479675:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918308992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601457.479751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601457.479879:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918308992 00000100:00100000:1.0:1789601457.479890:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918308992 00000100:00100000:1.0:1789601457.479966:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789601457.479976:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918308992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601457.479999:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789601457.480038:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601457.480073:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918308992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601457.480080:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789601457.480081:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a97480 x1876532918308992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601457.480100:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918308992:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789601457.803831:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601458.529987:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601458.530025:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918309120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601458.530212:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601458.531841:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309120 00000100:00100000:1.0:1789601458.531856:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309120 00000100:00100000:1.0:1789601458.531938:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601458.531951:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918309120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601458.531999:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601458.532104:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918309120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601458.532112:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789601458.532304:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918309120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601458.822061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601459.017910:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601459.017945:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918309248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601459.018056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601459.018132:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309248 00000100:00100000:1.0:1789601459.018142:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309248 00000100:00100000:1.0:1789601459.018209:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789601459.018221:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918309248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601459.018263:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789601459.018324:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918309248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601459.018349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789601459.018457:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918309248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601459.845863:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601460.002485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601460.002581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601460.002642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601460.002678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310528 00000100:00100000:3.0:1789601460.002692:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310528 00000100:00100000:3.0:1789601460.002756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:3.0:1789601460.002768:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898310528:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601460.002975:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898310528:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601460.002983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:0.0:1789601460.004948:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310656 00000100:00100000:0.0:1789601460.004968:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310656 00000100:00100000:0.0:1789601460.005056:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310784 00000100:00100000:0.0:1789601460.005060:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310784 00000100:00100000:0.0:1789601460.005091:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:0.0:1789601460.005104:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898310656:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601460.005202:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898310656:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 102us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.005212:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:0.0:1789601460.005232:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:0.0:1789601460.005238:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898310784:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601460.005266:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898310784:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.005272:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00080000:0.0:1789601460.005294:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601460.005299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601460.562215:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918309632:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918310144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562401:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918310656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562480:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562508:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789601460.562515:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918309504:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562545:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562595:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918310016:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562654:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918310528:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.562675:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601460.562709:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309632 00000100:00100000:3.0:1789601460.562718:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309632 00000100:00100000:1.0:1789601460.562834:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918309760:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.562879:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.562894:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918310272:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.562920:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.562938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918310784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.562961:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.562980:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789601460.562985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918309376:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.563027:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.563050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918309888:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.563077:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.563093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918310400:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.563112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.563125:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918310912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.563142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601460.563168:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309888 00000100:00100000:1.0:1789601460.563172:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309888 00000100:00100000:1.0:1789601460.563224:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789601460.563234:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c32da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918309888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601460.563302:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c32da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918309888:12345-0@lo:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601460.563310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789601460.563363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918309888:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.564670:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601460.564673:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310144 00000100:00100000:3.0:1789601460.564686:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918309632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.564709:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310144 00000100:00100000:0.0:1789601460.564796:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310656 00000100:00100000:0.0:1789601460.564800:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310656 00000100:00100000:3.0:1789601460.564817:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918309632:12345-0@lo:400:kworker.0 Request processed in 134us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.564822:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309504 00000100:00100000:0.0:1789601460.564827:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309504 00000100:00100000:3.0:1789601460.564829:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601460.564853:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310016 00000100:00100000:0.0:1789601460.564858:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310016 00000100:00100000:0.0:1789601460.564872:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310528 00000100:00100000:0.0:1789601460.564874:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310528 00000100:00100000:0.0:1789601460.564884:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309760 00000100:00100000:0.0:1789601460.564886:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309760 00000100:00100000:0.0:1789601460.564901:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789601460.564911:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918310144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565011:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918310144:12345-0@lo:400:kworker.0 Request processed in 101us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565029:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789601460.565052:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789601460.565062:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918310656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601460.565070:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918309376 00000100:00100000:2.0:1789601460.565080:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918309376 00000100:00100000:0.0:1789601460.565100:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918310656:12345-0@lo:400:kworker.0 Request processed in 41us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565109:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789601460.565131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789601460.565138:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601460.565148:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918309376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565155:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918309504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565218:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918309504:12345-0@lo:400:kworker.0 Request processed in 71us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601460.565230:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918309376:12345-0@lo:400:kworker.0 Request processed in 82us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565241:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601460.565250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789601460.565262:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601460.565272:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918310016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601460.565329:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918309376:0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565330:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918310016:12345-0@lo:400:kworker.0 Request processed in 59us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565350:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601460.565375:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601460.565382:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918310528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565414:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918310528:12345-0@lo:400:kworker.0 Request processed in 33us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565419:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601460.565433:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789601460.565440:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918309760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.565481:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918309760:12345-0@lo:400:kworker.0 Request processed in 43us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.565488:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789601460.567271:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310272 00000100:00100000:0.0:1789601460.567286:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310272 00000100:00100000:0.0:1789601460.567355:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310784 00000100:00100000:0.0:1789601460.567359:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310784 00000100:00100000:0.0:1789601460.567373:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310400 00000100:00100000:0.0:1789601460.567376:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310400 00000100:00100000:0.0:1789601460.567392:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918310912 00000100:00100000:0.0:1789601460.567396:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918310912 00000100:00100000:0.0:1789601460.567412:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601460.567421:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918310272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567493:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918310272:12345-0@lo:400:kworker.0 Request processed in 73us (4571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.567500:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601460.567515:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601460.567532:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918310784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567582:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918310784:12345-0@lo:400:kworker.0 Request processed in 50us (4620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.567588:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601460.567600:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601460.567605:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918310400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567634:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918310400:12345-0@lo:400:kworker.0 Request processed in 29us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.567639:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601460.567650:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601460.567655:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918310912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567688:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918310912:12345-0@lo:400:kworker.0 Request processed in 32us (4543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.567694:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789601460.567738:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601460.567742:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601460.567744:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601460.567747:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601460.567761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918309504:0@lo:400:kworker.0 00010000:00080000:0.0:1789601460.567778:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a3100 x1876532918310400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601460.567783:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918310016:0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567799:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918310400:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.567804:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918310528:0@lo:400:kworker.0 00010000:00080000:0.0:1789601460.567817:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a1f80 x1876532918310912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601460.567824:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918309632:0@lo:400:kworker.0 00000100:00100000:0.0:1789601460.567833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918310912:0@lo:400:kworker.0 00010000:00080000:3.0:1789601460.567842:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a1500 x1876532918310144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601460.567851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918309760:0@lo:400:kworker.0 00000100:00100000:3.0:1789601460.567861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918310144:0@lo:400:kworker.0 00010000:00080000:0.0:1789601460.567877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a3b80 x1876532918310272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601460.567887:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918310272:0@lo:400:kworker.0 00010000:00080000:0.0:1789601460.567901:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a2680 x1876532918310784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601460.567908:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918310784:0@lo:400:kworker.0 00010000:00080000:3.0:1789601460.568092:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a0700 x1876532918310656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601460.568113:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918310656:0@lo:400:kworker.0 00010000:00010000:1.0:1789601460.869778:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601461.062774:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601461.062802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601461.062911:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601461.063010:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311040 00000100:00100000:3.0:1789601461.063032:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311040 00000100:00100000:3.0:1789601461.063099:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601461.063109:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918311040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601461.063147:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601461.063199:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918311040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601461.063208:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789601461.063266:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318df80 x1876532918311040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601461.063287:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601461.064081:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918311168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601461.064144:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601461.064202:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311168 00000100:00100000:0.0:1789601461.064209:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311168 00000100:00100000:0.0:1789601461.064244:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601461.064252:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918311168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601461.064275:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601461.064321:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918311168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601461.064329:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789601461.064365:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3481f80 x1876532918311168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601461.064383:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918311168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789601461.893822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601462.597918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918311296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601462.597987:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601462.598231:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918311424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601462.598262:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601462.600041:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311296 00000100:00100000:2.0:1789601462.600052:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311296 00000100:00100000:2.0:1789601462.600201:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311424 00000100:00100000:2.0:1789601462.600204:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311424 00000100:00080000:0.0:1789601462.600429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601462.600528:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789601462.600539:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918311296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601462.600601:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601462.600669:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918311296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601462.600676:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789601462.600693:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789601462.600700:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918311424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601462.600721:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601462.600771:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918311424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601462.600778:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789601462.600926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e0700 x1876532918311424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601462.600945:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918311424:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789601462.601096:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318df80 x1876532918311296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601462.601109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918311296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601462.922168:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601463.622708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918311552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601463.622819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601463.622873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311552 00000100:00100000:2.0:1789601463.622882:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311552 00000100:00100000:2.0:1789601463.622945:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789601463.622957:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918311552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601463.622991:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601463.623057:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918311552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601463.623064:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789601463.623123:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918311552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601463.947148:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601464.137764:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918311680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601464.137847:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601464.137920:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311680 00000100:00100000:0.0:1789601464.137934:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311680 00000100:00100000:0.0:1789601464.137979:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601464.137989:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918311680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601464.138035:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601464.138088:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918311680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601464.138096:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601464.138165:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918311680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601464.965673:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601465.121063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601465.121123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601465.121222:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311040 00000100:00100000:1.0:1789601465.121233:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311040 00000100:00100000:1.0:1789601465.121307:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:1.0:1789601465.121318:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898311040:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601465.121388:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898311040:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601465.121395:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:1.0:1789601465.121727:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898310912 00000100:00100000:1.0:1789601465.121733:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898310912 00000100:00100000:1.0:1789601465.121768:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00100000:1.0:1789601465.121775:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2417:x1876532898310912:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601465.121807:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2417:x1876532898310912:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601465.121814:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00080000:3.0:1789601465.122020:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601465.122099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601465.122345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311168 00000100:00100000:3.0:1789601465.122350:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311168 00000100:00100000:3.0:1789601465.122394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:3.0:1789601465.122402:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898311168:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601465.122440:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898311168:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601465.122447:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00080000:1.0:1789601465.122510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601465.671092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918311936:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918312448:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671234:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671259:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918312960:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671277:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789601465.671307:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918311808:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671333:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918312320:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671393:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918312832:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918313344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601465.671491:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311936 00000100:00100000:2.0:1789601465.671498:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311936 00000100:00100000:2.0:1789601465.671592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312448 00000100:00100000:2.0:1789601465.671596:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312448 00000100:00100000:2.0:1789601465.671617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312960 00000100:00100000:2.0:1789601465.671619:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312960 00000100:00100000:2.0:1789601465.671635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789601465.671642:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918311936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671688:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918311936:12345-0@lo:400:kworker.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.671695:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789601465.671712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789601465.671718:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918312448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671741:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918312448:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.671747:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789601465.671757:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789601465.671762:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671784:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918312960:12345-0@lo:400:kworker.0 Request processed in 22us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.671790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789601465.671823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918311808 00000100:00100000:2.0:1789601465.671827:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918311808 00000100:00100000:2.0:1789601465.671852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789601465.671858:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918311808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671893:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918311808:12345-0@lo:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.671899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789601465.671922:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312320 00000100:00100000:2.0:1789601465.671925:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312320 00000100:00100000:2.0:1789601465.671952:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789601465.671958:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.671999:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918312320:12345-0@lo:400:kworker.0 Request processed in 41us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.672005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789601465.672023:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312832 00000100:00100000:2.0:1789601465.672026:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312832 00000100:00100000:2.0:1789601465.672050:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313344 00000100:00100000:2.0:1789601465.672052:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313344 00000100:00100000:2.0:1789601465.672069:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601465.672075:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672103:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918312832:12345-0@lo:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.672108:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601465.672118:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601465.672123:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918313344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672144:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918313344:12345-0@lo:400:kworker.0 Request processed in 21us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.672149:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789601465.672168:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601465.672171:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601465.672173:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601465.672207:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918311808:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918312320:0@lo:400:kworker.0 00010000:00080000:2.0:1789601465.672228:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e1180 x1876532918312832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601465.672238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918312832:0@lo:400:kworker.0 00010000:00080000:2.0:1789601465.672246:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a0a80 x1876532918313344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601465.672255:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918313344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672264:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918311936:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672271:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918312448:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.672278:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918312960:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674418:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918312064:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674481:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601465.674533:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918312576:0@lo:400:kworker.0 00000100:00100000:3.0:1789601465.674578:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312064 00000100:00100000:0.0:1789601465.674585:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601465.674588:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312064 00000100:00100000:0.0:1789601465.674609:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918313088:0@lo:400:kworker.0 00000100:00100000:3.0:1789601465.674634:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601465.674637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601465.674646:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918312064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674661:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789601465.674671:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918312192:0@lo:400:kworker.0 00000100:00100000:3.0:1789601465.674708:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918312064:12345-0@lo:400:kworker.0 Request processed in 63us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601465.674708:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601465.674718:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601465.674729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918312704:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601465.674782:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918313216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674801:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601465.674834:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918312064:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.674868:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312704 00000100:00100000:0.0:1789601465.674872:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312704 00000100:00100000:2.0:1789601465.674873:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312576 00000100:00100000:2.0:1789601465.674880:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312576 00000100:00100000:0.0:1789601465.674912:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313216 00000100:00100000:2.0:1789601465.674920:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313088 00000100:00100000:2.0:1789601465.674925:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313088 00000100:00100000:0.0:1789601465.674925:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313216 00000100:00100000:2.0:1789601465.674944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918312192 00000100:00100000:2.0:1789601465.674946:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918312192 00000100:00100000:0.0:1789601465.674957:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789601465.674970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789601465.674971:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.674994:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918312576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.675045:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918312704:12345-0@lo:400:kworker.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.675047:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918312576:12345-0@lo:400:kworker.0 Request processed in 67us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601465.675060:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789601465.675061:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789601465.675080:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789601465.675084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789601465.675090:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918313216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.675096:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918313088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.675127:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918313216:12345-0@lo:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601465.675134:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789601465.675143:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918313088:12345-0@lo:400:kworker.0 Request processed in 51us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601465.675151:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601465.675169:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00010000:00080000:0.0:1789601465.675176:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e0e00 x1876532918312704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601465.675178:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918312192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.675193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918312704:0@lo:400:kworker.0 00010000:00080000:0.0:1789601465.675208:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a2300 x1876532918313216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601465.675214:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918312192:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601465.675223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918313216:0@lo:400:kworker.0 00000100:00100000:2.0:1789601465.675227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00080000:0.0:1789601465.675241:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2300 x1876532918312576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601465.675251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918312576:0@lo:400:kworker.0 00000100:00080000:2.0:1789601465.675253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601465.675259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601465.675262:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601465.675264:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a1500 x1876532918313088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601465.675274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918313088:0@lo:400:kworker.0 00000100:00100000:0.0:1789601465.675297:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918312192:0@lo:400:kworker.0 00010000:00010000:2.0:1789601465.990648:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601466.181800:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918313472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601466.181869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601466.181946:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313472 00000100:00100000:0.0:1789601466.181954:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313472 00000100:00100000:0.0:1789601466.182009:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789601466.182018:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918313472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601466.182047:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601466.182092:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918313472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601466.182099:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1789601466.182137:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318ce00 x1876532918313472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601466.182154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918313472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601466.182336:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918313600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601466.182363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601466.182506:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313600 00000100:00100000:3.0:1789601466.182510:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313600 00000100:00100000:3.0:1789601466.182540:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789601466.182548:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918313600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601466.182580:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601466.182614:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918313600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601466.182630:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789601466.182659:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318f480 x1876532918313600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601466.182672:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918313600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601467.014870:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601467.721349:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601467.721375:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c35a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918313728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601467.721446:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601467.721504:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313728 00000100:00100000:1.0:1789601467.721511:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313728 00000100:00100000:1.0:1789601467.721601:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601467.721611:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918313728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601467.721641:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601467.721685:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918313728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601467.721693:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789601467.721713:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601467.721744:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c35a2a00 x1876532918313728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601467.721763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c35a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918313728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601467.725348:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601467.725374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918313856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601467.725446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601467.725748:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313856 00000100:00100000:2.0:1789601467.725757:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313856 00000100:00100000:2.0:1789601467.725827:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789601467.725836:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918313856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601467.725859:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601467.725909:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918313856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601467.725916:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789601467.726000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265180 x1876532918313856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601467.726019:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918313856:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789601467.726069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789601468.038014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601468.741832:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601468.741856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918313984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601468.741922:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601468.742224:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918313984 00000100:00100000:2.0:1789601468.742233:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918313984 00000100:00100000:2.0:1789601468.742287:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789601468.742296:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918313984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601468.742329:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601468.742380:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918313984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601468.742401:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789601468.742494:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918313984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789601469.062810:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601469.255532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918314112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601469.255624:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601469.255871:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314112 00000100:00100000:2.0:1789601469.255880:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314112 00000100:00100000:2.0:1789601469.255932:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789601469.255941:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918314112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601469.255983:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601469.256041:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918314112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601469.256048:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789601469.256399:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918314112:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601470.085812:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601470.247297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601470.247356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601470.247389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601470.247485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311424 00000100:00100000:2.0:1789601470.247495:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311424 00000100:00100000:2.0:1789601470.247585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311552 00000100:00100000:2.0:1789601470.247588:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311552 00000100:00100000:2.0:1789601470.247613:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:2.0:1789601470.247623:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898311424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601470.247690:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898311424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601470.247697:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:2.0:1789601470.247716:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:2.0:1789601470.247723:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898311552:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601470.247748:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898311552:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601470.247754:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00080000:1.0:1789601470.247969:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601470.247974:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601470.250067:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311296 00000100:00100000:3.0:1789601470.250080:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311296 00000100:00100000:3.0:1789601470.250148:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 293 00000100:00100000:3.0:1789601470.250158:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898311296:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601470.250236:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898311296:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 79us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.250243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 293 00000100:00100000:3.0:1789601470.793468:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918314624:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793535:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793608:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793632:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918315648:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793816:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793849:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789601470.793856:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918314240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793904:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918314752:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793925:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918315264:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.793972:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.793987:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918315776:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.794450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918314368:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918314880:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795596:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795615:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918315392:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789601470.795678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918314496:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795703:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795722:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918315008:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795742:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795753:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918315520:0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.795772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601470.795800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314624 00000100:00100000:3.0:1789601470.795818:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314624 00000100:00100000:3.0:1789601470.795856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314368 00000100:00100000:3.0:1789601470.795859:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314368 00000100:00100000:3.0:1789601470.795871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314880 00000100:00100000:3.0:1789601470.795874:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314880 00000100:00100000:3.0:1789601470.795897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315392 00000100:00100000:3.0:1789601470.795900:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315392 00000100:00100000:3.0:1789601470.795912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315008 00000100:00100000:3.0:1789601470.795914:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315008 00000100:00100000:3.0:1789601470.795926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315520 00000100:00100000:3.0:1789601470.795929:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315520 00000100:00100000:3.0:1789601470.795955:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601470.795966:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918314624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796032:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918314624:12345-0@lo:400:kworker.0 Request processed in 68us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601470.796059:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601470.796065:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918314368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796095:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918314368:12345-0@lo:400:kworker.0 Request processed in 31us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796101:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601470.796113:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601470.796118:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918314880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796141:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918314880:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796147:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601470.796157:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601470.796162:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918315392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796854:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918315392:12345-0@lo:400:kworker.0 Request processed in 690us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601470.796877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601470.796884:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918315008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796912:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918315008:12345-0@lo:400:kworker.0 Request processed in 29us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601470.796929:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789601470.796935:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918315520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.796976:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918315520:12345-0@lo:400:kworker.0 Request processed in 41us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.796981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789601470.797616:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315136 00000100:00100000:1.0:1789601470.797623:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315136 00000100:00100000:1.0:1789601470.797664:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315648 00000100:00100000:1.0:1789601470.797677:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315648 00000100:00100000:1.0:1789601470.797697:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315264 00000100:00100000:1.0:1789601470.797700:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315264 00000100:00100000:1.0:1789601470.797714:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315776 00000100:00100000:1.0:1789601470.797716:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315776 00000100:00100000:1.0:1789601470.797731:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789601470.797753:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918315136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.797795:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918315136:12345-0@lo:400:kworker.0 Request processed in 57us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.797801:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789601470.797815:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601470.797822:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918315648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.797849:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918315648:12345-0@lo:400:kworker.0 Request processed in 28us (4033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.797854:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601470.797866:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601470.797872:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918315264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.797898:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918315264:12345-0@lo:400:kworker.0 Request processed in 27us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.797904:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601470.797914:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601470.797920:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918315776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.797957:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918315776:12345-0@lo:400:kworker.0 Request processed in 26us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.797963:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789601470.799163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314240 00000100:00100000:3.0:1789601470.799171:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314240 00000100:00100000:3.0:1789601470.799545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789601470.799581:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918314240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601470.799646:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918314240:12345-0@lo:400:kworker.0 Request processed in 93us (5762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.799664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1789601470.799764:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601470.799770:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601470.799784:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601470.799787:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601470.799801:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314752 00000100:00100000:1.0:1789601470.799805:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314752 00000100:00100000:1.0:1789601470.799833:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918314496 00000100:00100000:1.0:1789601470.799836:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918314496 00000100:00100000:1.0:1789601470.799849:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601470.799857:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918314752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.799895:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918314752:12345-0@lo:400:kworker.0 Request processed in 39us (5969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.799901:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601470.799914:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601470.799920:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918314496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.799959:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918314496:12345-0@lo:400:kworker.0 Request processed in 39us (4254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601470.799964:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601470.800032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918314496:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318d500 x1876532918315008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918315008:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318ce00 x1876532918315520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918315520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918314368:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918314880:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800117:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918315392:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918314240:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800169:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918314752:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800196:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318f100 x1876532918315264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800205:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918315264:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800221:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8ab1f80 x1876532918315776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918315776:0@lo:400:kworker.0 00000100:00100000:1.0:1789601470.800238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918314624:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800250:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318fb80 x1876532918315136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800257:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918315136:0@lo:400:kworker.0 00010000:00080000:1.0:1789601470.800270:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8ab0700 x1876532918315648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601470.800278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918315648:0@lo:400:kworker.0 00010000:00010000:3.0:1789601471.109876:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601471.119170:0:12000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:31:09 (1789601469) === 00000100:00100000:2.0:1789601471.301758:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918315904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601471.301840:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601471.301970:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918315904 00000100:00100000:0.0:1789601471.301978:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918315904 00000100:00100000:0.0:1789601471.302034:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789601471.302043:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918315904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601471.302070:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601471.302114:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918315904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.302120:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601471.302191:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918316032:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789601471.302220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c5500 x1876532918315904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601471.302238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601471.302246:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918315904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601471.302423:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316032 00000100:00100000:0.0:1789601471.302427:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316032 00000100:00100000:0.0:1789601471.302456:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789601471.302462:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918316032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601471.302472:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601471.302507:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918316032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.302514:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789601471.302537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6d80 x1876532918316032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601471.302587:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918316032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601471.694879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.695031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311680 00000100:00100000:3.0:1789601471.695047:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311680 00000100:00100000:3.0:1789601471.695124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 295 00000100:00100000:3.0:1789601471.695146:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:8760:x1876532898311680:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789601471.695168:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601471.695191:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f1628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a489ed expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601471.695229:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f1628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489ed expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601471.695242:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f1628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489ed expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601471.695252:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363000, rc 0) 00000100:00100000:3.0:1789601471.695328:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898311680:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 184us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.695336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 295 00000100:00100000:1.0:1789601471.701706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.701814:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311808 00000100:00100000:3.0:1789601471.701828:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311808 00000100:00100000:3.0:1789601471.701916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 296 00000100:00100000:3.0:1789601471.701928:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898311808:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789601471.702162:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898311808:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 234us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.702192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 296 00000100:00100000:1.0:1789601471.711709:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601471.711823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898311936 00000100:00100000:0.0:1789601471.711837:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898311936 00000100:00100000:0.0:1789601471.711923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 297 00000100:00100000:0.0:1789601471.711946:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898311936:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601471.712153:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898311936:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 218us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.712161:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 297 00000100:00100000:1.0:1789601471.724179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.729143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312064 00000100:00100000:2.0:1789601471.729166:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312064 00000100:00100000:2.0:1789601471.729244:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 298 00000100:00100000:2.0:1789601471.729257:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312064:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601471.729614:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312064:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 359us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.729624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 298 00000100:00100000:1.0:1789601471.764606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.765534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312192 00000100:00100000:3.0:1789601471.765600:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312192 00000100:00100000:3.0:1789601471.765684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:3.0:1789601471.765701:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312192:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789601471.765961:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312192:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 266us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.765971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:1.0:1789601471.780231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601471.780590:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312320 00000100:00100000:0.0:1789601471.780605:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312320 00000100:00100000:0.0:1789601471.780680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 300 00000100:00100000:0.0:1789601471.780692:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312320:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601471.780915:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8764:x1876532898312320:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 224us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.780924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 300 00000100:00100000:1.0:1789601471.787538:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.787623:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312448 00000100:00100000:2.0:1789601471.787638:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312448 00000100:00100000:2.0:1789601471.787763:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 301 00000100:00100000:2.0:1789601471.787775:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:8760:x1876532898312448:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601471.787798:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601471.787821:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f162f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.787857:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f162f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a1e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.787870:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f162f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a1e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.787881:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383200, rc 0) 00000100:00100000:2.0:1789601471.787995:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:8760:x1876532898312448:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 222us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.788003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 301 00000100:00100000:1.0:1789601471.791640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.791765:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312576 00000100:00100000:3.0:1789601471.791778:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312576 00000100:00100000:3.0:1789601471.791853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 302 00000100:00100000:3.0:1789601471.791864:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:8760:x1876532898312576:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789601471.791898:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789601471.791928:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789601471.791932:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789601471.791935:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789601471.791947:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789601471.791949:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789601471.797037:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:8760:x1876532898312576:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 5158us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.797225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 302 00000100:00100000:1.0:1789601471.802427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.806278:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312704 00000100:00100000:2.0:1789601471.806302:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312704 00000100:00100000:2.0:1789601471.806401:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 303 00000100:00100000:2.0:1789601471.806414:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:8760:x1876532898312704:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601471.806677:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601471.806704:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a25 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.809678:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.809711:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601471.809724:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382400, rc 0) 00000100:00100000:2.0:1789601471.811358:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8760:x1876532898312704:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 4932us (8931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.811372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 303 00000100:00100000:1.0:1789601471.837665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.837745:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312832 00000100:00100000:3.0:1789601471.837759:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312832 00000100:00100000:3.0:1789601471.837830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 304 00000100:00100000:3.0:1789601471.837843:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8760:x1876532898312832:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789601471.838076:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8760:x1876532898312832:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 235us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.838085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 304 00000100:00100000:1.0:1789601471.845593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.845866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898312960 00000100:00100000:2.0:1789601471.845880:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898312960 00000100:00100000:2.0:1789601471.845961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 305 00000100:00100000:2.0:1789601471.845985:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8760:x1876532898312960:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789601471.846392:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8760:x1876532898312960:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 420us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.846413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 305 00000100:00100000:0.0:1789601471.868873:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.869493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313088 00000100:00100000:2.0:1789601471.869506:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313088 00000100:00100000:2.0:1789601471.869622:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 306 00000100:00100000:2.0:1789601471.869635:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8768:x1876532898313088:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601471.869963:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8768:x1876532898313088:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 329us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.869972:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 306 00000100:00100000:1.0:1789601471.893970:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.894166:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313216 00000100:00100000:3.0:1789601471.894194:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313216 00000100:00100000:3.0:1789601471.894288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 307 00000100:00100000:3.0:1789601471.894302:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8768:x1876532898313216:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789601471.894534:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:8768:x1876532898313216:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 234us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.894544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 307 00000100:00100000:1.0:1789601471.902819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601471.902858:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601471.902885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601471.902927:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601471.902969:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313344 00000100:00100000:1.0:1789601471.902979:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313344 00000100:00100000:1.0:1789601471.903008:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313600 00000100:00100000:1.0:1789601471.903011:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313600 00000100:00100000:1.0:1789601471.903018:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314112 00000100:00100000:1.0:1789601471.903021:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314112 00000100:00100000:1.0:1789601471.903041:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313984 00000100:00100000:1.0:1789601471.903044:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313984 00000100:00100000:1.0:1789601471.903060:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:1.0:1789601471.903071:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898314112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601471.903147:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898314112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601471.903154:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:1.0:1789601471.903171:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:1.0:1789601471.903178:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898313984:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601471.903204:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898313984:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601471.903229:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:1.0:1789601471.903244:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789601471.903249:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2414:x1876532898313344:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789601471.903272:0:9040:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a1d2becd-b915-45a6-b68d-98afb78edf03@192.168.203.48@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1789601471.903304:0:9040:0:(genops.c:1384:class_connect()) connect: client a1d2becd-b915-45a6-b68d-98afb78edf03, cookie 0x74872e3eca9f163d 00000004:00100000:1.0:1789601471.903328:0:9040:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789601471.903436:0:9040:0:(import.c:65:import_set_state_nolock()) ffff8df3c298b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601471.903466:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2414:x1876532898313344:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 216us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601471.903472:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789601471.903485:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789601471.903489:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2414:x1876532898313600:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789601471.903504:0:9040:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a1d2becd-b915-45a6-b68d-98afb78edf03@192.168.203.48@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1789601471.903526:0:9040:0:(genops.c:1384:class_connect()) connect: client a1d2becd-b915-45a6-b68d-98afb78edf03, cookie 0x74872e3eca9f1644 00000004:00100000:1.0:1789601471.903537:0:9040:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789601471.903628:0:9040:0:(import.c:65:import_set_state_nolock()) ffff8df3c23db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601471.903651:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2414:x1876532898313600:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 160us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601471.903657:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789601471.908324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601471.908383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601471.908420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.908536:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313728 00000100:00100000:2.0:1789601471.908542:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313472 00000100:00100000:3.0:1789601471.908548:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313728 00000100:00100000:2.0:1789601471.908606:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313472 00000100:00080000:0.0:1789601471.908706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601471.908711:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601471.908819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898313856 00000100:00100000:0.0:1789601471.908825:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898313856 00000100:00100000:2.0:1789601471.917293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1789601471.917331:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:0:x1876532898313728:12345-192.168.203.48@tcp:41:mount.lustre.0 00000100:00100000:3.0:1789601471.917380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000004:00000024:2.0:1789601471.917396:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601471.917413:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+7:0:x1876532898313472:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789601471.917481:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601471.917552:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:0:x1876532898313728:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 241us (9236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.917590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789601471.917617:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+7:0:x1876532898313472:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 217us (9228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.917628:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:3.0:1789601471.917638:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601471.917645:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+7:8760:x1876532898313856:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789601471.917668:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601471.917712:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898313856:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 75us (9291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601471.917721:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1789601471.922081:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.922254:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314240 00000100:00100000:3.0:1789601471.922264:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314240 00000100:00100000:3.0:1789601471.922329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601471.922340:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314240:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789601471.922437:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314240:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.922445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1789601471.925633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.925674:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601471.925727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601471.925834:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314368 00000100:00100000:0.0:1789601471.925844:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314368 00000100:00100000:0.0:1789601471.925890:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314496 00000100:00100000:0.0:1789601471.925894:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314496 00000100:00100000:0.0:1789601471.925912:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1789601471.925920:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2414:x1876532898314368:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601471.925965:0:8857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a1d2becd-b915-45a6-b68d-98afb78edf03@192.168.203.48@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:0.0:1789601471.925997:0:8857:0:(genops.c:1384:class_connect()) connect: client a1d2becd-b915-45a6-b68d-98afb78edf03, cookie 0x74872e3eca9f164b 00002000:00100000:0.0:1789601471.926009:0:8857:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1d2becd-b915-45a6-b68d-98afb78edf03/ffff8df3c354a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601471.926020:0:8857:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601471.926099:0:8857:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789601471.926127:0:8857:0:(import.c:65:import_set_state_nolock()) ffff8df3c354d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601471.926184:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2414:x1876532898314368:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 264us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.926192:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1789601471.926209:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1789601471.926214:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2414:x1876532898314496:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601471.926229:0:8857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a1d2becd-b915-45a6-b68d-98afb78edf03@192.168.203.48@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:0.0:1789601471.926244:0:8857:0:(genops.c:1384:class_connect()) connect: client a1d2becd-b915-45a6-b68d-98afb78edf03, cookie 0x74872e3eca9f1652 00002000:00100000:0.0:1789601471.926249:0:8857:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1d2becd-b915-45a6-b68d-98afb78edf03/ffff8df3c354e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601471.926261:0:8857:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601471.926304:0:8857:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601471.926319:0:8857:0:(import.c:65:import_set_state_nolock()) ffff8df3c354b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601471.926345:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2414:x1876532898314496:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 129us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601471.926351:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601471.927477:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314624 00000100:00100000:3.0:1789601471.927487:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314624 00000100:00100000:3.0:1789601471.927543:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789601471.927552:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314624:12345-192.168.203.48@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789601471.927779:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314624:12345-192.168.203.48@tcp:900:mount.lustre.0 Request processed in 227us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.927787:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789601471.931388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601471.931493:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314752 00000100:00100000:3.0:1789601471.931507:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314752 00000100:00100000:1.0:1789601471.931777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1789601471.931793:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314752:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789601471.931890:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789601471.932031:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:8760:x1876532898314752:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 243us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601471.932039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00010000:00010000:2.0:1789601472.133805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601472.838286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918316160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601472.838388:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601472.841911:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918316288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601472.842035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601472.842151:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316160 00000100:00100000:2.0:1789601472.842161:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316160 00000100:00100000:3.0:1789601472.842510:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316288 00000100:00100000:3.0:1789601472.842516:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316288 00000100:00100000:3.0:1789601472.842550:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789601472.842576:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f9e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918316160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601472.842632:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789601472.842700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601472.842716:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f9e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918316160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601472.842979:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789601472.843190:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c6d80 x1876532918316160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601472.843212:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918316160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601472.843701:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789601472.843713:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918316288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601472.843914:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601472.844075:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918316288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 365us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601472.844083:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789601472.845218:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e2680 x1876532918316288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601472.845244:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918316288:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789601473.158855:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601473.867734:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601473.867765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918316416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601473.867853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.869129:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316416 00000100:00100000:1.0:1789601473.869142:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316416 00000100:00100000:1.0:1789601473.869218:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601473.869230:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918316416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601473.869276:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601473.869366:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918316416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.869374:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601473.869433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918316416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601474.183500:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601474.374473:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601474.374517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918316544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601474.374627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601474.374716:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316544 00000100:00100000:0.0:1789601474.374726:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316544 00000100:00100000:0.0:1789601474.374787:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789601474.374797:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918316544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601474.374841:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601474.374895:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918316544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601474.374903:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789601474.374975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918316544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601475.206034:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601475.909945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918316928:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918317440:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910160:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918317952:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910210:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910240:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789601475.910253:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918317056:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918317568:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910331:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318080:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910369:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601475.910405:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316928 00000100:00100000:0.0:1789601475.910415:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316928 00000100:00100000:0.0:1789601475.910484:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789601475.910494:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910585:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918316928:12345-0@lo:400:kworker.0 Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.910594:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789601475.910619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317440 00000100:00100000:0.0:1789601475.910623:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317440 00000100:00100000:0.0:1789601475.910657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317952 00000100:00100000:0.0:1789601475.910659:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317952 00000100:00100000:0.0:1789601475.910671:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317056 00000100:00100000:0.0:1789601475.910673:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317056 00000100:00100000:0.0:1789601475.910685:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789601475.910692:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918317440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910723:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918317440:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.910729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789601475.910740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601475.910746:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918317952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910770:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918317952:12345-0@lo:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.910783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601475.910795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601475.910800:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918317056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910827:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918317056:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.910834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601475.910852:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317568 00000100:00100000:0.0:1789601475.910856:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317568 00000100:00100000:0.0:1789601475.910880:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318080 00000100:00100000:0.0:1789601475.910883:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318080 00000100:00100000:0.0:1789601475.910899:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601475.910918:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918317568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910949:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918317568:12345-0@lo:400:kworker.0 Request processed in 44us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.910956:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601475.910966:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789601475.910972:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.910994:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318080:12345-0@lo:400:kworker.0 Request processed in 23us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.911001:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789601475.911021:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601475.911026:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601475.911029:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601475.911060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918317056:0@lo:400:kworker.0 00010000:00080000:0.0:1789601475.911074:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12ac000 x1876532918317568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601475.911098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918317568:0@lo:400:kworker.0 00010000:00080000:0.0:1789601475.911111:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12ac380 x1876532918318080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601475.911119:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318080:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.911129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918316928:0@lo:400:kworker.0 00010000:00080000:0.0:1789601475.911138:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12af480 x1876532918317440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601475.911147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918317440:0@lo:400:kworker.0 00010000:00080000:0.0:1789601475.911155:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12adc00 x1876532918317952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601475.911163:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918317952:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911468:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918316672:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911552:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918317184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911611:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918317696:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911656:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911674:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918318208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911693:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789601475.911713:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918316800:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911765:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918317312:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918317824:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601475.911853:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316800 00000100:00100000:3.0:1789601475.911857:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316800 00000100:00100000:3.0:1789601475.911883:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317312 00000100:00100000:3.0:1789601475.911886:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317312 00000100:00100000:3.0:1789601475.911917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317824 00000100:00100000:3.0:1789601475.911920:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317824 00000100:00100000:3.0:1789601475.911936:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601475.911942:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918316800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.911991:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918316800:12345-0@lo:400:kworker.0 Request processed in 48us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.911996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601475.912014:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789601475.912020:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918317312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912045:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918317312:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.912057:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789601475.912070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601475.912076:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918317824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912105:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918317824:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.912111:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601475.912129:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317184 00000100:00100000:3.0:1789601475.912133:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317184 00000100:00100000:3.0:1789601475.912157:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789601475.912164:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918317184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912196:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918317184:12345-0@lo:400:kworker.0 Request processed in 33us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.912202:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789601475.912217:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601475.912227:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918317696 00000100:00100000:3.0:1789601475.912231:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918317696 00000100:00100000:3.0:1789601475.912252:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318208 00000100:00100000:3.0:1789601475.912255:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318208 00000100:00100000:3.0:1789601475.912269:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601475.912274:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918317696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912303:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918317696:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.912309:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601475.912490:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601475.912497:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918318208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912531:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918318208:12345-0@lo:400:kworker.0 Request processed in 35us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601475.912543:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789601475.912583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601475.912587:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601475.912623:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918316800:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912634:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918317312:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912643:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918317824:0@lo:400:kworker.0 00000100:00100000:3.0:1789601475.912652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918317184:0@lo:400:kworker.0 00010000:00080000:3.0:1789601475.912662:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12aed80 x1876532918317696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601475.912673:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918317696:0@lo:400:kworker.0 00010000:00080000:3.0:1789601475.912724:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12aea00 x1876532918318208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601475.912733:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918318208:0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.914219:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918316672 00000100:00100000:0.0:1789601475.914234:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918316672 00000100:00100000:0.0:1789601475.914325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789601475.914348:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918316672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601475.914891:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918316672:12345-0@lo:400:kworker.0 Request processed in 544us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.914900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789601475.915160:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918316672:0@lo:400:kworker.0 00010000:00010000:0.0:1789601476.231196:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601476.421884:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918318336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601476.422005:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601476.422039:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601476.422082:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601476.422182:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318336 00000100:00100000:3.0:1789601476.422194:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318336 00000100:00100000:3.0:1789601476.422246:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318464 00000100:00100000:3.0:1789601476.422249:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318464 00000100:00100000:3.0:1789601476.422267:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789601476.422279:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918318336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601476.422332:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601476.422390:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918318336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601476.422397:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789601476.422439:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789601476.422447:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601476.422458:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601476.422499:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601476.422505:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789601476.422587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c5500 x1876532918318336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601476.422611:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918318336:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789601476.422650:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb800 x1876532918318464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601476.422670:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318464:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789601477.257482:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601477.411291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411612:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601477.411732:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315136 00000100:00100000:1.0:1789601477.411763:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315136 00000100:00100000:1.0:1789601477.411844:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315392 00000100:00100000:1.0:1789601477.411848:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315392 00000100:00100000:1.0:1789601477.411864:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315008 00000100:00100000:1.0:1789601477.411867:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315008 00000100:00100000:1.0:1789601477.411881:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315264 00000100:00100000:1.0:1789601477.411883:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315264 00000100:00100000:1.0:1789601477.411912:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:1.0:1789601477.411926:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898315136:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601477.412472:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898315136:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 547us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601477.412482:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:1.0:1789601477.412506:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:1.0:1789601477.412514:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315392:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601477.412541:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315392:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601477.412548:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:1.0:1789601477.412591:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:1.0:1789601477.412598:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898315008:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601477.412625:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898315008:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601477.412631:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:1.0:1789601477.412642:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:1.0:1789601477.412647:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315264:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601477.412670:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315264:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601477.412686:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:3.0:1789601477.413091:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315648 00000100:00100000:3.0:1789601477.413100:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315648 00000100:00100000:3.0:1789601477.413148:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:3.0:1789601477.413156:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315648:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601477.413194:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315648:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601477.413201:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00080000:3.0:1789601477.413223:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601477.413228:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601477.413231:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601477.413285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601477.413457:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315520 00000100:00100000:3.0:1789601477.413462:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315520 00000100:00100000:3.0:1789601477.413499:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1789601477.413506:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315520:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601477.413540:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898315520:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601477.413547:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00080000:3.0:1789601477.413595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601477.414001:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898314880 00000100:00100000:2.0:1789601477.414008:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898314880 00000100:00100000:2.0:1789601477.414164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 309 00000100:00100000:2.0:1789601477.414176:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898314880:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601477.414222:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898314880:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 50us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601477.414247:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 309 00000100:00100000:3.0:1789601477.960401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918318592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601477.960500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601477.960616:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318592 00000100:00100000:3.0:1789601477.960625:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318592 00000100:00100000:3.0:1789601477.960687:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789601477.960696:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918318592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601477.960731:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601477.960779:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918318592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601477.960786:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789601477.960809:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601477.960839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8ab0700 x1876532918318592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601477.960858:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918318592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601477.961430:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918318720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601477.961480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601477.967769:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318720 00000100:00100000:3.0:1789601477.967789:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318720 00000100:00100000:3.0:1789601477.967879:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601477.967904:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918318720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601477.967938:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601477.968046:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918318720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (6566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601477.968055:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789601477.968087:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601477.968146:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36e3b80 x1876532918318720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601477.968174:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918318720:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1789601477.973934:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00100000:1.0:1789601477.974156:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00100000:2.0:1789601477.975199:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00100000:0.0:1789601477.975263:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:02000400:1.0:1789601477.985472:0:12193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789601478.281225:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601478.982728:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601478.982801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918318848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601478.982905:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601478.983026:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318848 00000100:00100000:1.0:1789601478.983036:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318848 00000100:00100000:1.0:1789601478.984088:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601478.984104:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918318848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601478.984151:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601478.984231:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918318848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601478.984239:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601478.987642:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918318848:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601479.302702:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601479.504075:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601479.504149:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601479.504227:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918318976 00000100:00100000:1.0:1789601479.504234:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918318976 00000100:00100000:1.0:1789601479.504281:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601479.504290:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601479.504324:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789601479.504370:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918318976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.504377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601479.504435:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918318976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601480.325793:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601481.035638:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918319104:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.035748:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601481.035805:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319104 00000100:00100000:0.0:1789601481.035815:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319104 00000100:00100000:0.0:1789601481.035930:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789601481.035945:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918319104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.042916:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918319104:12345-0@lo:400:kworker.0 Request processed in 6960us (7153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.042936:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789601481.043054:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918319488:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.043119:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601481.043184:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918319232:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.043208:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601481.043228:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601481.043235:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918319360:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.043259:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601481.043292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319488 00000100:00100000:0.0:1789601481.043302:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319488 00000100:00100000:0.0:1789601481.043345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319232 00000100:00100000:0.0:1789601481.043348:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319232 00000100:00100000:0.0:1789601481.043366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601481.043374:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918319488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.043449:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918319488:12345-0@lo:400:kworker.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.043456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601481.043469:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789601481.043475:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918319232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.043500:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918319232:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.043506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789601481.043551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918319488:0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.044648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918319872:0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.044713:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601481.044747:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918320384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.044771:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601481.044793:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601481.044799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918319744:0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.044819:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601481.044833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918320256:0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.044849:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.046447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918319104:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.046489:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918319616:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.046551:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.046657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918320128:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.046687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.046730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918320640:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.046753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.046774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789601481.046782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918320000:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.046806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.046825:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918320512:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.047639:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918319232:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.047669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319872 00000100:00100000:0.0:1789601481.047676:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319872 00000100:00100000:0.0:1789601481.047733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320384 00000100:00100000:0.0:1789601481.047737:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320384 00000100:00100000:0.0:1789601481.047749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319744 00000100:00100000:0.0:1789601481.047752:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319744 00000100:00100000:0.0:1789601481.047764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320256 00000100:00100000:0.0:1789601481.047767:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320256 00000100:00100000:0.0:1789601481.047782:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601481.047791:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918319872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.047887:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918319872:12345-0@lo:400:kworker.0 Request processed in 96us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.047895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601481.047913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789601481.047919:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918320384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.047947:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918320384:12345-0@lo:400:kworker.0 Request processed in 29us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.047970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789601481.047981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789601481.047986:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918319744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.048014:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918319744:12345-0@lo:400:kworker.0 Request processed in 28us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.048019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789601481.048028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789601481.048034:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918320256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.048057:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918320256:12345-0@lo:400:kworker.0 Request processed in 24us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601481.048063:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789601481.048094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601481.048100:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601481.048123:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918319744:0@lo:400:kworker.0 00000100:00100000:2.0:1789601481.048179:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320128 00000100:00100000:2.0:1789601481.048195:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320128 00000100:00100000:2.0:1789601481.048239:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320640 00000100:00100000:2.0:1789601481.048243:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320640 00000100:00100000:2.0:1789601481.048258:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320000 00000100:00100000:2.0:1789601481.048261:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320000 00000100:00100000:2.0:1789601481.048280:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789601481.048288:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601481.049789:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319360 00000100:00100000:3.0:1789601481.049802:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319360 00000100:00100000:3.0:1789601481.049852:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918319616 00000100:00100000:3.0:1789601481.049855:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918319616 00000100:00100000:3.0:1789601481.049882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789601481.049891:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918319360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.050900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.050976:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601481.050990:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.051059:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918319616:12345-0@lo:400:kworker.0 Request processed in 74us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.051067:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601481.051103:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320512 00000100:00100000:1.0:1789601481.051110:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320512 00000100:00100000:1.0:1789601481.051143:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601481.051151:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918320640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.052568:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918320640:12345-0@lo:400:kworker.0 Request processed in 1397us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.052597:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601481.052633:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601481.052643:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918320000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.052720:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918320000:12345-0@lo:400:kworker.0 Request processed in 80us (5913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.052726:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601481.052736:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601481.052743:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.052769:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918320512:12345-0@lo:400:kworker.0 Request processed in 27us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.052775:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1789601481.052853:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc4ea00 x1876532918320000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601481.052879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918320000:0@lo:400:kworker.0 00010000:00080000:1.0:1789601481.052893:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a94000 x1876532918320512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601481.052902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918320512:0@lo:400:kworker.0 00000100:00100000:1.0:1789601481.052915:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918319616:0@lo:400:kworker.0 00010000:00080000:1.0:1789601481.052927:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a96d80 x1876532918320640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601481.052935:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918320640:0@lo:400:kworker.0 00000100:00100000:0.0:1789601481.053863:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918320256:0@lo:400:kworker.0 00010000:00080000:0.0:1789601481.053894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc4f480 x1876532918319872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601481.053905:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918319872:0@lo:400:kworker.0 00010000:00080000:0.0:1789601481.053921:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a94a80 x1876532918320384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601481.053930:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918320384:0@lo:400:kworker.0 00000100:00100000:2.0:1789601481.053997:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918320128:12345-0@lo:400:kworker.0 Request processed in 5705us (7304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601481.054018:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789601481.054018:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc4df80 x1876532918320128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601481.054048:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918320128:0@lo:400:kworker.0 00000100:00080000:2.0:1789601481.054055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601481.054063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601481.056517:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918319360:12345-0@lo:400:kworker.0 Request processed in 6615us (13244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.056535:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789601481.056613:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918319360:0@lo:400:kworker.0 00010000:00010000:0.0:1789601481.349898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601481.541941:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601481.541971:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918320768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601481.542069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601481.542142:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320768 00000100:00100000:3.0:1789601481.542152:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320768 00000100:00100000:3.0:1789601481.542206:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601481.542216:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918320768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601481.542255:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601481.542306:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918320768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.542321:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1789601481.542375:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a94a80 x1876532918320768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601481.545740:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918320768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601481.545936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601481.546144:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918320896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601481.546239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.546307:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918320896 00000100:00100000:1.0:1789601481.546317:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918320896 00000100:00100000:1.0:1789601481.546371:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789601481.546500:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918320896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601481.546663:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601481.546731:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918320896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 348us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.546740:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1789601481.546808:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318fb80 x1876532918320896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601481.546832:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918320896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601482.378930:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601482.538383:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601482.538420:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601482.539455:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601482.539486:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601482.539508:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601482.548615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601482.550784:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315904 00000100:00100000:2.0:1789601482.550799:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315904 00000100:00100000:2.0:1789601482.550901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316160 00000100:00100000:2.0:1789601482.550905:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316160 00000100:00100000:2.0:1789601482.550921:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316032 00000100:00100000:2.0:1789601482.550924:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316032 00000100:00100000:2.0:1789601482.550942:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:2.0:1789601482.550951:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898315904:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601482.551079:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898315904:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 129us (12714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.551099:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:2.0:1789601482.551117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:2.0:1789601482.551124:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898316160:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601482.551150:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898316160:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (12730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.551156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:2.0:1789601482.551168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:2.0:1789601482.551174:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898316032:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601482.551197:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898316032:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (11688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.551203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00080000:3.0:1789601482.551270:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601482.551276:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601482.554841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601482.561505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316288 00000100:00100000:3.0:1789601482.561520:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316288 00000100:00080000:3.0:1789601482.561932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601482.561986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:3.0:1789601482.561996:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898316288:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601482.562072:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898316288:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 77us (13465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.562080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:1.0:1789601482.564152:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316416 00000100:00100000:1.0:1789601482.564165:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316416 00000100:00100000:1.0:1789601482.564225:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316544 00000100:00100000:1.0:1789601482.564229:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316544 00000100:00100000:1.0:1789601482.564254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789601482.564263:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898316416:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601482.564322:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898316416:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 60us (24870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.564346:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789601482.564361:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:1.0:1789601482.564367:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898316544:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601482.564404:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898316544:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (9569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.564409:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00080000:1.0:1789601482.564428:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601482.564432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601482.566083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898315776 00000100:00100000:1.0:1789601482.566094:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898315776 00000100:00100000:1.0:1789601482.566146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 311 00000100:00100000:1.0:1789601482.566156:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898315776:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601482.566215:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898315776:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 60us (26727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.566221:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 311 00000100:00100000:0.0:1789601483.078963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918321024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601483.079031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601483.079746:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321024 00000100:00100000:1.0:1789601483.079753:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321024 00000100:00100000:1.0:1789601483.079819:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789601483.079830:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918321024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601483.079865:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601483.079913:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918321024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.079920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789601483.079935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918321152:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789601483.079949:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601483.079965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789601483.080162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a94a80 x1876532918321024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601483.080189:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918321024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601483.081987:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321152 00000100:00100000:1.0:1789601483.081999:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321152 00000100:00100000:1.0:1789601483.082064:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601483.082073:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918321152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601483.082096:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789601483.082147:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601483.085686:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918321152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3602us (5707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.085703:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1789601483.086412:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318ed80 x1876532918321152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601483.086437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918321152:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789601483.397731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601484.101815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601484.101837:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918321280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601484.101961:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601484.102184:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321280 00000100:00100000:1.0:1789601484.102193:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321280 00000100:00100000:1.0:1789601484.102241:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601484.102250:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918321280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601484.102281:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601484.102355:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918321280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.102362:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789601484.102447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918321280:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601484.424048:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601484.628042:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601484.628066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918321408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601484.628131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601484.628201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321408 00000100:00100000:2.0:1789601484.628208:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321408 00000100:00100000:2.0:1789601484.628251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601484.628259:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918321408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601484.628291:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601484.628334:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918321408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.628341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601484.628421:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918321408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601485.446188:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601486.064490:0:12510:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601486.064891:0:12510:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789601486.154733:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601486.154762:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918321536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.157954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601486.158109:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918321664:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158142:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601486.158183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321664 00000100:00100000:0.0:1789601486.158191:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321664 00000100:00100000:0.0:1789601486.158401:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789601486.158412:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918321664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158465:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918321664:12345-0@lo:400:kworker.0 Request processed in 56us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601486.158485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789601486.158668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918321664:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158739:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918322048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158765:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601486.158791:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322048 00000100:00100000:0.0:1789601486.158795:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322048 00000100:00100000:0.0:1789601486.158821:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789601486.158827:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918322048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158871:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918322048:12345-0@lo:400:kworker.0 Request processed in 44us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601486.158877:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789601486.158898:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918322048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918322176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.158955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601486.161861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918321792:0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.161924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322176 00000100:00100000:3.0:1789601486.161954:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322176 00000100:00100000:3.0:1789601486.162034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789601486.162047:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918322176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.162169:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918322176:12345-0@lo:400:kworker.0 Request processed in 124us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.162184:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789601486.162218:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918321920:0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.162258:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601486.162294:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918322432:0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.162686:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601486.162762:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601486.162783:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321920 00000100:00100000:3.0:1789601486.162793:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321920 00000100:00100000:0.0:1789601486.162830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918322176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.162860:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601486.162864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789601486.162875:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918321920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.162879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918322560:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.162932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601486.162944:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918321920:12345-0@lo:400:kworker.0 Request processed in 70us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.162953:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789601486.162995:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918321920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.162998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918322688:0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.164389:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321536 00000100:00100000:1.0:1789601486.164399:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321536 00000100:00100000:1.0:1789601486.164456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789601486.164465:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918321536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.164538:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918321536:12345-0@lo:400:kworker.0 Request processed in 74us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.164545:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789601486.164630:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322432 00000100:00100000:1.0:1789601486.164635:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322432 00000100:00100000:1.0:1789601486.164665:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322560 00000100:00100000:1.0:1789601486.164668:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322560 00000100:00100000:1.0:1789601486.164686:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789601486.164692:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918322432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.164768:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918322432:12345-0@lo:400:kworker.0 Request processed in 76us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.164774:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789601486.164786:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789601486.164793:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918322560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.164820:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918322560:12345-0@lo:400:kworker.0 Request processed in 28us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.164826:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789601486.164876:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601486.164907:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb800 x1876532918322432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601486.164922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918322432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601486.166467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601486.166661:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789601486.166707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31ba680 x1876532918322560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601486.166720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918322560:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.166762:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918321536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.166809:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322688 00000100:00100000:0.0:1789601486.166816:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322688 00000100:00100000:0.0:1789601486.166878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789601486.166886:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601486.166933:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918322688:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601486.166940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789601486.166960:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601486.166980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918322688:0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.170740:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918321792 00000100:00100000:3.0:1789601486.170755:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918321792 00000100:00100000:3.0:1789601486.170814:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789601486.170824:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918321792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.170904:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601486.170920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918322816:0@lo:400:kworker.0 00000100:00100000:3.0:1789601486.170929:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918321792:12345-0@lo:400:kworker.0 Request processed in 105us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.170937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601486.170963:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601486.170999:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322816 00000100:00100000:1.0:1789601486.171003:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322816 00000100:00100000:1.0:1789601486.171038:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789601486.171046:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918322816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171081:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918322816:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.171105:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1789601486.171123:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789601486.171151:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318d500 x1876532918322816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601486.171164:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918322816:0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171202:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918322944:0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171225:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601486.171254:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322944 00000100:00100000:1.0:1789601486.171258:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322944 00000100:00100000:1.0:1789601486.171286:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601486.171293:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918322944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171330:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918322944:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.171337:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789601486.171354:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601486.171374:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318d500 x1876532918322944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601486.171383:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918322944:0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323072:0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601486.171466:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323072 00000100:00100000:1.0:1789601486.171470:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323072 00000100:00100000:1.0:1789601486.171497:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789601486.171503:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601486.171540:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323072:12345-0@lo:400:kworker.0 Request processed in 37us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.171552:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789601486.171589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601486.171605:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318d500 x1876532918323072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601486.171615:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323072:0@lo:400:kworker.0 00000100:00100000:2.0:1789601486.172194:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918321792:0@lo:400:kworker.0 00000100:00100000:2.0:1789601486.172202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918322304:0@lo:400:kworker.0 00000100:00100000:2.0:1789601486.172230:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601486.176310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918322304 00000100:00100000:3.0:1789601486.176326:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918322304 00000100:00100000:3.0:1789601486.176401:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789601486.176412:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918322304:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789601486.177429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601486.178693:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918322304:12345-0@lo:400:kworker.0 Request processed in 2274us (6452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.178707:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:2.0:1789601486.183851:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bbb80 x1876532918322304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601486.183871:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918322304:0@lo:400:kworker.0 00010000:00010000:3.0:1789601486.469736:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601486.661682:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601486.661704:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601486.661772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601486.661874:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323200 00000100:00100000:3.0:1789601486.661882:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323200 00000100:00100000:3.0:1789601486.661932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601486.661940:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601486.661969:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601486.662014:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.662021:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1789601486.662063:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8ce00 x1876532918323200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601486.662080:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601486.662442:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918323328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601486.662474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601486.662584:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323328 00000100:00100000:3.0:1789601486.662589:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323328 00000100:00100000:3.0:1789601486.662617:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789601486.662624:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918323328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601486.662635:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601486.662671:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918323328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.662677:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789601486.662770:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8ce00 x1876532918323328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601486.662782:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918323328:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789601487.502309:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601487.658756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601487.658805:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601487.658842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601487.658868:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601487.658897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601487.659103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316928 00000100:00100000:3.0:1789601487.659114:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316928 00000100:00100000:3.0:1789601487.659167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316800 00000100:00100000:3.0:1789601487.659170:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316800 00000100:00100000:3.0:1789601487.659184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317056 00000100:00100000:3.0:1789601487.659186:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317056 00000100:00100000:3.0:1789601487.659205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:3.0:1789601487.659225:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898316928:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601487.659295:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898316928:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601487.659303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:3.0:1789601487.659322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:3.0:1789601487.659329:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898316800:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601487.659363:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898316800:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601487.659369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:3.0:1789601487.659382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:3.0:1789601487.659389:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317056:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601487.659414:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317056:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601487.659420:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00080000:3.0:1789601487.659438:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601487.659441:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601487.660360:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317312 00000100:00100000:0.0:1789601487.660372:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317312 00000100:00100000:0.0:1789601487.660415:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789601487.660424:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317312:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601487.660465:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317312:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 42us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601487.660471:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1789601487.660739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898316672 00000100:00100000:1.0:1789601487.660744:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898316672 00000100:00100000:1.0:1789601487.660787:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 313 00000100:00100000:1.0:1789601487.660794:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898316672:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601487.660837:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898316672:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601487.660844:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 313 00000100:00080000:3.0:1789601487.662288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601487.677226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601487.677269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601487.677304:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317440 00000100:00100000:1.0:1789601487.677314:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317440 00000100:00100000:1.0:1789601487.677385:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:1.0:1789601487.677396:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898317440:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601487.677466:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898317440:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601487.677474:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00080000:3.0:1789601487.678184:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601487.678200:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317184 00000100:00100000:3.0:1789601487.678205:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317184 00000100:00100000:3.0:1789601487.678276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1789601487.678284:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898317184:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601487.678323:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898317184:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601487.678330:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00080000:2.0:1789601487.678927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601488.197966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601488.197990:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918323456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601488.198058:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601488.198171:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323456 00000100:00100000:1.0:1789601488.198180:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323456 00000100:00100000:1.0:1789601488.198244:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789601488.198261:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918323456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601488.198291:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601488.198349:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918323456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601488.198356:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789601488.198590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601488.198621:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31ba680 x1876532918323456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601488.198641:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918323456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601488.198866:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601488.198895:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601488.198959:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323584 00000100:00100000:1.0:1789601488.198964:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323584 00000100:00100000:1.0:1789601488.199001:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789601488.199008:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601488.199017:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601488.199048:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918323584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601488.199054:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789601488.199140:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601488.199158:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb800 x1876532918323584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601488.199172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918323584:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1789601488.300870:0:12607:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601488.301110:0:12607:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789601488.520808:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601489.223029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918323712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601489.223096:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601489.223215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323712 00000100:00100000:3.0:1789601489.223223:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323712 00000100:00100000:3.0:1789601489.223273:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789601489.223282:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918323712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601489.223311:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601489.223476:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918323712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601489.223484:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789601489.223619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918323712:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601489.545356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601489.733850:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601489.733873:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918323840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601489.733935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601489.734101:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323840 00000100:00100000:2.0:1789601489.734109:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323840 00000100:00100000:2.0:1789601489.734184:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789601489.734194:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918323840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601489.734334:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601489.734897:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918323840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 704us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601489.734906:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601489.735371:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918323840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601490.572520:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789601490.593216:0:12704:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601490.593436:0:12704:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789601491.270809:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918324352:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.270876:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.270932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918324864:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.270958:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.270978:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918325376:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271050:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789601491.271056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918323968:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271094:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271116:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918324480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271139:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918324992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271175:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271190:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918325504:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271208:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271234:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918324096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.271257:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.271290:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918324608:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.272590:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.272639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918325120:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.272682:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.272711:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789601491.272718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918324224:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.272744:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.272774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918324736:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.272807:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.272822:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918325248:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.272842:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601491.272876:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324352 00000100:00100000:1.0:1789601491.272884:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324352 00000100:00100000:1.0:1789601491.272924:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324096 00000100:00100000:1.0:1789601491.272928:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324096 00000100:00100000:1.0:1789601491.272938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324608 00000100:00100000:1.0:1789601491.272954:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324608 00000100:00100000:1.0:1789601491.272980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325120 00000100:00100000:1.0:1789601491.272983:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325120 00000100:00100000:1.0:1789601491.272995:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324736 00000100:00100000:1.0:1789601491.272998:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324736 00000100:00100000:1.0:1789601491.273008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325248 00000100:00100000:1.0:1789601491.273010:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325248 00000100:00100000:1.0:1789601491.273024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601491.273032:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.273091:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918324352:12345-0@lo:400:kworker.0 Request processed in 59us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.273098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601491.273115:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601491.273121:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.273155:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918324096:12345-0@lo:400:kworker.0 Request processed in 35us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.273161:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601491.273173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789601491.273179:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.273206:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918324608:12345-0@lo:400:kworker.0 Request processed in 28us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.273212:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789601491.273235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789601491.273243:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.273279:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918325120:12345-0@lo:400:kworker.0 Request processed in 38us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.273285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789601491.275431:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789601491.275452:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.275532:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918324736:12345-0@lo:400:kworker.0 Request processed in 88us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601491.277569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789601491.277592:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918325248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.277598:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789601491.277654:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324864 00000100:00100000:1.0:1789601491.277661:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324864 00000100:00100000:3.0:1789601491.277677:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918325248:12345-0@lo:400:kworker.0 Request processed in 96us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601491.277686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789601491.277697:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325376 00000100:00100000:1.0:1789601491.277701:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325376 00000100:00100000:1.0:1789601491.277716:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324992 00000100:00100000:1.0:1789601491.277719:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324992 00000100:00100000:1.0:1789601491.277732:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325504 00000100:00100000:1.0:1789601491.277734:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325504 00000100:00100000:1.0:1789601491.277939:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789601491.277950:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918324864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.277989:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918324864:12345-0@lo:400:kworker.0 Request processed in 43us (7031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.277995:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789601491.278007:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789601491.278014:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278042:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918325376:12345-0@lo:400:kworker.0 Request processed in 28us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278048:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789601491.278057:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601491.278063:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278087:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918324992:12345-0@lo:400:kworker.0 Request processed in 25us (6911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278104:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601491.278116:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601491.278121:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918325504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278150:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918325504:12345-0@lo:400:kworker.0 Request processed in 30us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278156:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601491.278178:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918323968 00000100:00100000:1.0:1789601491.278183:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918323968 00000100:00100000:1.0:1789601491.278221:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789601491.278228:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278258:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918323968:12345-0@lo:400:kworker.0 Request processed in 31us (7163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789601491.278293:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324480 00000100:00100000:1.0:1789601491.278297:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324480 00000100:00100000:1.0:1789601491.278329:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918324224 00000100:00100000:1.0:1789601491.278333:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918324224 00000100:00100000:1.0:1789601491.278346:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601491.278352:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918324480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278384:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918324480:12345-0@lo:400:kworker.0 Request processed in 32us (7244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278390:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601491.278404:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789601491.278411:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.278440:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918324224:12345-0@lo:400:kworker.0 Request processed in 30us (5695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.278455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1789601491.278492:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601491.278496:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601491.278499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601491.278502:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601491.280424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918324224:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280456:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8946680 x1876532918324736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918324736:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8944380 x1876532918325248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918325248:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918324096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280507:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918324608:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280517:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918325120:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280646:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918323968:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280659:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918324480:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280671:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8945880 x1876532918324992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280679:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918324992:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280690:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8947800 x1876532918325504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280708:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918325504:0@lo:400:kworker.0 00000100:00100000:1.0:1789601491.280722:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918324352:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280732:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8944700 x1876532918324864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280739:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918324864:0@lo:400:kworker.0 00010000:00080000:1.0:1789601491.280938:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8946a00 x1876532918325376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.280947:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918325376:0@lo:400:kworker.0 00010000:00010000:1.0:1789601491.595601:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601491.782083:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918325632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601491.782183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601491.782706:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325632 00000100:00100000:2.0:1789601491.782728:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325632 00000100:00100000:2.0:1789601491.782787:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601491.782810:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918325632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601491.782850:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601491.782914:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918325632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601491.782923:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1789601491.783068:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3482300 x1876532918325632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601491.783091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918325632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601491.785321:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918325760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601491.785409:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601491.785657:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325760 00000100:00100000:2.0:1789601491.785667:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325760 00000100:00100000:2.0:1789601491.785735:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601491.785746:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918325760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601491.785773:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601491.785843:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918325760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601491.785850:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1789601491.785898:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3482680 x1876532918325760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601491.785918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918325760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601492.613775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601492.771254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771287:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771317:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771363:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771384:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601492.771541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317568 00000100:00100000:0.0:1789601492.771552:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317568 00000100:00100000:0.0:1789601492.771653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 315 00000100:00100000:0.0:1789601492.771665:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898317568:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601492.771752:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898317568:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 89us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.771772:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 315 00000100:00100000:0.0:1789601492.771823:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317824 00000100:00100000:0.0:1789601492.771827:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317824 00000100:00100000:0.0:1789601492.771865:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318080 00000100:00100000:0.0:1789601492.771868:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318080 00000100:00100000:0.0:1789601492.771880:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317696 00000100:00100000:0.0:1789601492.771882:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317696 00000100:00100000:0.0:1789601492.771897:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898317952 00000100:00100000:0.0:1789601492.771899:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898317952 00000100:00100000:0.0:1789601492.771912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789601492.771918:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898317824:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601492.771953:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898317824:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.771960:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789601492.771971:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:0.0:1789601492.771977:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898318080:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601492.772191:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898318080:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 212us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.772199:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:0.0:1789601492.772212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:0.0:1789601492.772218:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898317696:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601492.772243:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898317696:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.772248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:0.0:1789601492.772259:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:0.0:1789601492.772274:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317952:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601492.773203:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898317952:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 922us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.773215:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:0.0:1789601492.773271:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318208 00000100:00100000:0.0:1789601492.773279:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318208 00000100:00100000:0.0:1789601492.773399:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318336 00000100:00100000:0.0:1789601492.773403:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318336 00000100:00100000:0.0:1789601492.773443:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789601492.773453:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2414:x1876532898318208:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:0.0:1789601492.773482:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f164b 00000100:00080000:0.0:1789601492.773493:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c354d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601492.773572:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789601492.773734:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+2:2414:x1876532898318208:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 283us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.773741:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789601492.773754:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601492.773761:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2414:x1876532898318336:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:0.0:1789601492.773773:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1652 00000100:00080000:0.0:1789601492.773780:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c354b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601492.773819:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789601492.773892:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+2:2414:x1876532898318336:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 131us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601492.773898:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00010000:00010000:3.0:1789601492.776484:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601492.776624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601492.776632:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601492.776646:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601492.776650:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789601492.776673:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789601493.032513:0:12802:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601493.033096:0:12802:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789601493.318020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601493.318042:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918325888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601493.318123:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601493.318203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918326016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601493.318227:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601493.318270:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918325888 00000100:00100000:2.0:1789601493.318278:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918325888 00000100:00100000:2.0:1789601493.318319:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326016 00000100:00100000:2.0:1789601493.318322:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326016 00000100:00100000:2.0:1789601493.318343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789601493.318353:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918325888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601493.318381:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601493.318434:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918325888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601493.318441:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789601493.318459:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789601493.318466:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918326016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601493.318475:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601493.318499:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918326016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601493.318504:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789601493.318604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c362e680 x1876532918326016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601493.318621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918326016:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789601493.318633:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3482680 x1876532918325888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601493.318643:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918325888:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789601493.318747:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601493.637771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601494.343676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601494.343708:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918326144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601494.343806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601494.343886:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326144 00000100:00100000:3.0:1789601494.343896:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326144 00000100:00100000:3.0:1789601494.343959:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789601494.343970:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918326144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601494.344024:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601494.344081:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918326144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601494.344089:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789601494.344143:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918326144:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601494.662236:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601494.856347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601494.856379:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918326272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601494.856476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601494.856551:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326272 00000100:00100000:3.0:1789601494.856580:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326272 00000100:00100000:3.0:1789601494.856637:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601494.856646:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918326272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601494.856691:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789601494.856745:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918326272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601494.856752:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601494.856822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918326272:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789601495.259857:0:12899:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601495.260104:0:12899:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789601495.686520:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601496.389907:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918326656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601496.389978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.390138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918326400:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390175:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.390208:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601496.390214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918326528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.390269:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918326784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390291:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.390323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326400 00000100:00100000:1.0:1789601496.390330:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326400 00000100:00100000:1.0:1789601496.390377:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789601496.390387:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390435:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918326400:12345-0@lo:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.390442:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789601496.390473:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326528 00000100:00100000:1.0:1789601496.390477:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326528 00000100:00100000:1.0:1789601496.390500:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326784 00000100:00100000:1.0:1789601496.390503:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326784 00000100:00100000:1.0:1789601496.390524:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789601496.390530:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918326528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390580:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918326528:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.390586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789601496.390598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789601496.390604:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918326784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390635:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918326784:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.390648:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789601496.390698:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918326784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390724:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918326528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.390731:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918326400:0@lo:400:kworker.0 00000100:00100000:2.0:1789601496.392474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326656 00000100:00100000:2.0:1789601496.392486:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326656 00000100:00100000:2.0:1789601496.392542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789601496.392550:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918326656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601496.392654:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918326656:12345-0@lo:400:kworker.0 Request processed in 104us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601496.392679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789601496.392769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918326656:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.393024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918326912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.393061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601496.393121:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918326912 00000100:00100000:3.0:1789601496.393126:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918326912 00000100:00100000:3.0:1789601496.393158:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789601496.393166:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918326912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601496.393295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918327040:0@lo:400:kworker.0 00000100:00100000:2.0:1789601496.393325:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601496.393419:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918326912:12345-0@lo:400:kworker.0 Request processed in 254us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601496.393434:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789601496.393489:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918326912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.393510:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327040 00000100:00100000:1.0:1789601496.393514:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327040 00000100:00100000:1.0:1789601496.393621:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789601496.393628:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918327040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.393665:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918327040:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.393671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789601496.393696:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918327040:0@lo:400:kworker.0 00000100:00080000:2.0:1789601496.393781:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601496.393973:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918327168:0@lo:400:kworker.0 00000100:00100000:3.0:1789601496.394003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601496.394058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327168 00000100:00100000:2.0:1789601496.394064:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327168 00000100:00100000:2.0:1789601496.394094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789601496.394101:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918327168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394183:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918327296:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394211:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.394241:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327296 00000100:00100000:1.0:1789601496.394245:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327296 00000100:00100000:1.0:1789601496.394270:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789601496.394277:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918327296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394324:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918327296:12345-0@lo:400:kworker.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.394331:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789601496.394360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cca80 x1876532918327296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.394370:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918327296:0@lo:400:kworker.0 00000100:00100000:2.0:1789601496.394432:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918327168:12345-0@lo:400:kworker.0 Request processed in 331us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601496.394440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1789601496.394457:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601496.394460:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601496.394617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918327808:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.394665:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601496.394671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918327680:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.394713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327680 00000100:00100000:1.0:1789601496.394717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327680 00000100:00100000:1.0:1789601496.394748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789601496.394754:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918327680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394798:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918327680:12345-0@lo:400:kworker.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.394804:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1789601496.394829:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789601496.394847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cdf80 x1876532918327680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.394856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918327680:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394884:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918327424:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394909:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.394936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918327936:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394957:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.394970:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601496.394975:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918327552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.394991:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601496.395010:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327808 00000100:00100000:1.0:1789601496.395013:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327808 00000100:00100000:1.0:1789601496.395035:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327424 00000100:00100000:1.0:1789601496.395037:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327424 00000100:00100000:1.0:1789601496.395048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327936 00000100:00100000:1.0:1789601496.395050:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327936 00000100:00100000:1.0:1789601496.395061:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789601496.395065:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918327808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.395097:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918327808:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.395102:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789601496.395112:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601496.395117:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918327424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.395146:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918327424:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.395151:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601496.395161:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601496.395167:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918327936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.395188:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918327936:12345-0@lo:400:kworker.0 Request processed in 21us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.395193:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601496.395210:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918327552 00000100:00100000:1.0:1789601496.395220:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918327552 00000100:00100000:1.0:1789601496.395244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789601496.395250:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918327552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.395279:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918327552:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.395284:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1789601496.395296:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601496.395298:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601496.395300:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601496.395318:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cd180 x1876532918327808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.395326:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918327808:0@lo:400:kworker.0 00000100:00100000:1.0:1789601496.395346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918327552:0@lo:400:kworker.0 00010000:00080000:1.0:1789601496.395355:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cc700 x1876532918327424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.395363:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918327424:0@lo:400:kworker.0 00010000:00080000:1.0:1789601496.395370:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cd880 x1876532918327936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.395377:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918327936:0@lo:400:kworker.0 00010000:00080000:3.0:1789601496.396179:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cf100 x1876532918327168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601496.396192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918327168:0@lo:400:kworker.0 00010000:00010000:0.0:1789601496.711030:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601496.902078:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601496.902102:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918328192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601496.902169:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601496.902241:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328192 00000100:00100000:3.0:1789601496.902248:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328192 00000100:00100000:3.0:1789601496.902309:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789601496.902318:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918328192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601496.902345:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601496.902388:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918328192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601496.902395:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1789601496.902434:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2a8ca80 x1876532918328192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601496.902451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918328192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601496.902962:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918328064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601496.902997:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601496.903142:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328064 00000100:00100000:3.0:1789601496.903147:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328064 00000100:00100000:3.0:1789601496.903183:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789601496.903190:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918328064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601496.903220:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601496.903262:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918328064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (264us total) trans 0 rc 0/0 00010000:00080000:1.0:1789601496.903364:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3482680 x1876532918328064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601496.903378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918328064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601496.903428:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1789601497.733786:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601497.891716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601497.891775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601497.891822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601497.891864:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601497.891906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318464 00000100:00100000:3.0:1789601497.891917:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601497.891925:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318464 00000100:00100000:3.0:1789601497.891954:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318720 00000100:00100000:3.0:1789601497.891965:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318720 00000100:00100000:0.0:1789601497.892028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 317 00000100:00100000:3.0:1789601497.892043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318976 00000100:00100000:0.0:1789601497.892050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898318464:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601497.892051:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318976 00000100:00100000:3.0:1789601497.892077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318592 00000100:00100000:3.0:1789601497.892082:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318592 00000100:00100000:3.0:1789601497.892101:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898318848 00000100:00100000:3.0:1789601497.892104:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898318848 00000100:00100000:3.0:1789601497.892128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:3.0:1789601497.892140:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898318720:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601497.892169:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898318464:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 114us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601497.892180:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 317 00000100:00100000:3.0:1789601497.892210:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898318720:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 71us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601497.892219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:3.0:1789601497.892244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:3.0:1789601497.892256:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898318976:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601497.892303:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898318976:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 52us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601497.892330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:3.0:1789601497.892355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:3.0:1789601497.892365:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898318592:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601497.892406:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898318592:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601497.892414:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:3.0:1789601497.892432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:3.0:1789601497.892441:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898318848:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601497.892481:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898318848:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601497.892488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00080000:1.0:1789601497.892666:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601497.892674:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601498.441269:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601498.441293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918328320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601498.441364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601498.441617:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328320 00000100:00100000:3.0:1789601498.441625:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328320 00000100:00100000:3.0:1789601498.441679:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789601498.441690:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918328320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601498.441717:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601498.441775:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918328320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601498.441782:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789601498.441801:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601498.441810:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918328448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601498.441836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601498.441863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601498.441874:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328448 00000100:00100000:3.0:1789601498.441893:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328448 00000100:00100000:3.0:1789601498.441933:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789601498.441939:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918328448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601498.441964:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601498.441996:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918328448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601498.442002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789601498.442017:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601498.442041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92d80 x1876532918328448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601498.442057:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918328448:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789601498.442087:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cf800 x1876532918328320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601498.442097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918328320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601498.758104:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789601498.954623:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000020:00000080:2.0:1789601498.954638:0:8434:0:(genops.c:885:class_export_put()) final put ffff8df3c354a000/a1d2becd-b915-45a6-b68d-98afb78edf03 00000020:00000080:1.0:1789601498.954681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c354a000/a1d2becd-b915-45a6-b68d-98afb78edf03 for lustre-OST0000 00000020:00000080:1.0:1789601498.954757:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c354d000 for lustre-OST0000 00000001:00100000:1.0:1789601498.962840:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000020:00000080:1.0:1789601498.962852:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df3c354e000/a1d2becd-b915-45a6-b68d-98afb78edf03 00000020:00000080:2.0:1789601498.963105:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c354e000/a1d2becd-b915-45a6-b68d-98afb78edf03 for lustre-OST0001 00000020:00000080:2.0:1789601498.963169:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c354b000 for lustre-OST0001 00000001:02000400:0.0:1789601499.187297:0:13043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789601499.462836:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601499.462868:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918328576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601499.462978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.463047:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328576 00000100:00100000:3.0:1789601499.463055:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328576 00000100:00100000:3.0:1789601499.463111:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789601499.463122:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918328576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601499.463163:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789601499.463226:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918328576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601499.463233:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789601499.463262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918328576:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601499.785979:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601499.974305:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601499.974338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918328704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601499.974427:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.974547:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328704 00000100:00100000:3.0:1789601499.974809:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328704 00000100:00100000:0.0:1789601499.982804:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789601499.982822:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918328704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601499.982876:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601499.983001:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918328704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601499.983026:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789601499.983067:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918328704:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601500.805970:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601501.520369:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918328960:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.520369:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918329216:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.520445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918328832:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.523432:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601501.523513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918329728:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.523548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601501.523581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918330240:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.523603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601501.524784:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329728 00000100:00100000:0.0:1789601501.524796:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329728 00000100:00100000:0.0:1789601501.524854:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330240 00000100:00100000:0.0:1789601501.524857:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330240 00000100:00100000:0.0:1789601501.524883:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601501.524894:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918329728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.525074:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918329728:12345-0@lo:400:kworker.0 Request processed in 183us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.525082:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601501.525097:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789601501.525103:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918330240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.525128:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918330240:12345-0@lo:400:kworker.0 Request processed in 26us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.525133:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789601501.528631:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601501.528696:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918329344:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.528745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601501.528777:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918329856:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.528802:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601501.528821:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918330368:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.528843:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601501.528896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329344 00000100:00100000:0.0:1789601501.529152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328832 00000100:00100000:0.0:1789601501.529161:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328832 00000100:00100000:0.0:1789601501.529215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789601501.529234:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918328832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.529299:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918328832:12345-0@lo:400:kworker.0 Request processed in 67us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.529306:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789601501.529358:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329856 00000100:00100000:0.0:1789601501.529361:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329856 00000100:00100000:0.0:1789601501.529384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330368 00000100:00100000:0.0:1789601501.529387:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330368 00000100:00100000:0.0:1789601501.529404:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601501.529425:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918329856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.529454:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918329856:12345-0@lo:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.529459:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601501.529470:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789601501.529475:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918330368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.529499:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918330368:12345-0@lo:400:kworker.0 Request processed in 24us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.529504:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789601501.529569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918328832:0@lo:400:kworker.0 00010000:00080000:0.0:1789601501.529585:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376ce00 x1876532918329856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601501.529596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918329856:0@lo:400:kworker.0 00010000:00080000:0.0:1789601501.529605:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376e300 x1876532918330368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601501.529613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918330368:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.529728:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329344 00000100:00100000:1.0:1789601501.529767:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789601501.529774:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918329344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.529811:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918329344:12345-0@lo:400:kworker.0 Request processed in 38us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601501.529816:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789601501.529837:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918329344:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530036:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329216 00000100:00100000:3.0:1789601501.530041:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329216 00000100:00100000:3.0:1789601501.530107:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789601501.530114:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918329216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530149:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918329216:12345-0@lo:400:kworker.0 Request processed in 37us (6726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.530155:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789601501.530284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918329088:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530319:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601501.530375:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918329600:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530398:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601501.530426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918330112:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530445:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601501.530470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601501.530475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601501.530540:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601501.530575:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918329472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601501.530612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329600 00000100:00100000:3.0:1789601501.530616:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329600 00000100:00100000:3.0:1789601501.530637:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330112 00000100:00100000:2.0:1789601501.530637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918329216:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530639:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330112 00010000:00080000:2.0:1789601501.530651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376f800 x1876532918329728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601501.530664:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918328960 00000100:00100000:3.0:1789601501.530666:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918328960 00000100:00100000:2.0:1789601501.530667:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918329728:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329472 00000100:00100000:3.0:1789601501.530677:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329472 00010000:00080000:2.0:1789601501.530680:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376ed80 x1876532918330240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601501.530688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918330240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789601501.530694:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918329600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530736:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918329600:12345-0@lo:400:kworker.0 Request processed in 42us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.530742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789601501.530755:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789601501.530760:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530785:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918330112:12345-0@lo:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.530791:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789601501.530802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789601501.530807:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918328960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530831:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918328960:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.530837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789601501.530849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789601501.530854:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918329472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601501.530875:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918329472:12345-0@lo:400:kworker.0 Request processed in 22us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.530880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1789601501.530891:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601501.530894:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789601501.538958:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376d880 x1876532918329600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601501.538995:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918329600:0@lo:400:kworker.0 00000100:00100000:0.0:1789601501.541232:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329088 00000100:00100000:0.0:1789601501.541246:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329088 00000100:00100000:0.0:1789601501.541303:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789601501.541313:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918329088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.543053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918329472:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.543068:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918329984:0@lo:400:kworker.0 00010000:00080000:3.0:1789601501.543084:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376c000 x1876532918330112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601501.543095:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918330112:0@lo:400:kworker.0 00000100:00100000:2.0:1789601501.543131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601501.543175:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918329088:12345-0@lo:400:kworker.0 Request processed in 1861us (12853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601501.543187:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789601501.543201:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918328960:0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.543271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918329984 00000100:00100000:1.0:1789601501.543283:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918329984 00000100:00100000:1.0:1789601501.543332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789601501.543339:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918329984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601501.543382:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918329984:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601501.543387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789601501.543814:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918329088:0@lo:400:kworker.0 00000100:00080000:2.0:1789601501.544010:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601501.544031:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918329984:0@lo:400:kworker.0 00010000:00010000:0.0:1789601501.829796:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601502.021779:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918330496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601502.022120:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918330624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601502.022340:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.023006:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330624 00000100:00100000:1.0:1789601502.023015:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330624 00000100:00100000:1.0:1789601502.023076:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789601502.023087:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918330624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601502.023117:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601502.023181:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918330624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.023187:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1789601502.023277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8945880 x1876532918330624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601502.023297:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918330624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601502.030683:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.030867:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330496 00000100:00100000:1.0:1789601502.030876:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330496 00000100:00100000:1.0:1789601502.030934:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789601502.030945:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918330496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601502.030968:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601502.031028:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918330496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.031035:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1789601502.031218:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8947800 x1876532918330496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601502.031239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918330496:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1789601502.394553:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc409ad40 20000000:00000080:1.0:1789601502.395729:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df3c3169800 uarg=0000000000000000 20000000:01000000:1.0:1789601502.395778:0:13191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789601502.395784:0:13191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789601502.395789:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789601502.399080:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789601502.402704:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789601502.416452:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789601502.416606:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416626:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416636:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416643:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416649:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f160c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416655:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f161a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416662:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416669:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416723:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416738:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 12 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.416752:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918330752:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601502.416863:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.416872:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 23 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.416881:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918330880:0@lo:104: 00000100:00100000:1.0:1789601502.416918:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601502.418190:0:7463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918330880 00000100:00100000:2.0:1789601502.418202:0:7463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918330880 00000100:00100000:2.0:1789601502.418278:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601502.418289:0:7463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918330880:12345-0@lo:104: 00010000:00010000:2.0:1789601502.418306:0:7463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.418372:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601502.418378:0:7463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918330880:12345-0@lo:104: Request processed in 93us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.418399:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1789601502.418697:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.418722:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 23 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.418736:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331008:0@lo:104: 00000100:00100000:1.0:1789601502.418771:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.418804:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331008 00000100:00100000:1.0:1789601502.418809:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331008 00000100:00100000:1.0:1789601502.418836:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601502.418842:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331008:12345-0@lo:104: 00010000:00010000:1.0:1789601502.418850:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.418905:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601502.418910:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331008:12345-0@lo:104: Request processed in 69us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.418915:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789601502.419905:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601502.419914:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.419922:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601502.419926:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.419935:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601502.419942:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420523:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601502.420530:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420538:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601502.420541:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420586:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601502.420591:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601502.420594:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601502.420629:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420633:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601502.420655:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420662:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f160c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1613 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420696:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.420698:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.420700:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601502.420724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918331136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.420777:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601502.420844:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331136 00000100:00100000:0.0:1789601502.420850:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331136 00010000:00010000:0.0:1789601502.420875:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601502.420902:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601502.420910:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918331136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601502.420921:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601502.420926:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.420936:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.421188:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601502.421227:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918331136:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (449us total) trans 0 rc 0/0 10000000:01000000:2.0:1789601502.421353:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601502.421380:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.421386:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601502.421396:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.421402:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382c00/0x74872e3eca9f161a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.421411:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601502.421413:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601502.421414:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601502.421484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601502.421502:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319104 00000100:00100000:3.0:1789601502.421508:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319104 00010000:00010000:2.0:1789601502.421538:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.421601:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:2.0:1789601502.421609:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898319104:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.421617:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.421622:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.421658:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.421682:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 24 pid: 6516 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.421693:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331264:0@lo:104: 00000100:00100000:1.0:1789601502.421735:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.421761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331264 00000100:00100000:1.0:1789601502.421765:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331264 00000100:00100000:1.0:1789601502.421800:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601502.421806:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331264:12345-0@lo:104: 00010000:00010000:1.0:1789601502.421817:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.421853:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601502.421858:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331264:12345-0@lo:104: Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.421865:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601502.422076:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789601502.422098:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601502.422102:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.422110:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601502.422120:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.422128:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601502.422135:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601502.422140:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601502.422173:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.422180:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601502.422196:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.422203:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f15fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.422213:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.422214:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.422216:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601502.422237:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918331520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.422265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601502.422297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918331392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.422320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601502.422401:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918331136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.422423:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331520 00000100:00100000:0.0:1789601502.422433:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331520 00010000:00010000:0.0:1789601502.422448:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 24 pid: 6516 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601502.422466:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331392 00000100:00100000:0.0:1789601502.422469:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331392 00010000:00010000:0.0:1789601502.422481:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601502.422493:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601502.422500:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3645:x1876532918331520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601502.422509:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601502.422513:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 25 pid: 6516 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.423103:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.423122:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601502.423170:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898319104:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1562us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.423178:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:2.0:1789601502.423200:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601502.423207:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3648:x1876532918331392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.423216:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.423221:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.423321:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.423331:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 25 pid: 6514 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.423342:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331648:0@lo:104: 00000100:00100000:1.0:1789601502.423377:0:13191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601502.423417:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.423427:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.423450:0:13191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331776:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601502.423482:0:13191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8ba1b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789601502.423500:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382400/0x74872e3eca9f1636 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a25 expref: 12 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.423513:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918330752:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601502.423523:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918330880:0@lo:104: 00010000:00010000:1.0:1789601502.423532:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f1613 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f160c expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.423539:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331008:0@lo:104: 00010000:00010000:0.0:1789601502.423739:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 24 pid: 6516 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.423753:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601502.423804:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.423815:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef600/0x74872e3eca9f1621 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f161a expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.423824:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601502.423869:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f15fe expref: 23 pid: 6516 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.423878:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331264:0@lo:104: 00000100:00100000:0.0:1789601502.423958:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3645:x1876532918331520:12345-0@lo:103:ldlm_bl.0 Request processed in 1450us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601502.423966:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601502.424105:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331648 00000100:00100000:0.0:1789601502.424111:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331648 00000100:00100000:0.0:1789601502.424148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601502.424156:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331648:12345-0@lo:104: 00010000:00010000:0.0:1789601502.424167:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424221:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601502.424239:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13191:x1876532918331648:12345-0@lo:104: Request processed in 85us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601502.424246:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789601502.424263:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601502.424270:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424277:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601502.424281:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424289:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601502.424296:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601502.424302:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601502.424326:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424332:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601502.424346:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424352:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382200/0x74872e3eca9f15f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f15f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.424366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.424367:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601502.424369:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601502.424387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918331904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.424416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601502.424794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918331904 00000100:00100000:3.0:1789601502.424799:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918331904 00010000:00010000:3.0:1789601502.424819:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 22 pid: 6514 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601502.424847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601502.424853:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3646:x1876532918331904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601502.424862:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601502.424866:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 22 pid: 6514 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.424876:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 22 pid: 6514 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.424887:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601502.424929:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3646:x1876532918331904:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601502.424936:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601502.424983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918331904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601502.425109:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918331520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601502.425141:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f15f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f15f0 expref: 21 pid: 6514 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.425151:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331648:0@lo:104: 00000100:00100000:1.0:1789601502.427826:0:13191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1876532918331776:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601502.427873:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.428041:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3648:x1876532918331392:12345-0@lo:103:ldlm_bl.0 Request processed in 4832us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.428067:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789601502.428149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918331392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601502.429966:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601502.430138:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319232 00000100:00100000:2.0:1789601502.430146:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319232 00010000:00010000:2.0:1789601502.430182:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.430222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789601502.430238:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:2417:x1876532898319232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.430252:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.430258:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430271:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430288:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73efc00/0x74872e3eca9f15e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489e6 expref: 12 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430304:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430312:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430328:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430334:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430356:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430363:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430368:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601502.430371:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.430379:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.432035:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.432039:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.432059:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601502.432062:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.432068:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef800/0x74872e3eca9f1659 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.432129:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:2417:x1876532898319232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1896us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.432139:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00010000:00010000:2.0:1789601502.854089:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601503.015908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.015958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.016073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.016370:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601503.016431:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319360 00000100:00100000:2.0:1789601503.016448:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319360 00000100:00100000:2.0:1789601503.016516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319616 00000100:00100000:2.0:1789601503.016519:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319616 00000100:00100000:2.0:1789601503.016533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319488 00000100:00100000:2.0:1789601503.016535:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319488 00000100:00100000:2.0:1789601503.016586:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:2.0:1789601503.016597:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898319360:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601503.016680:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898319360:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 84us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.016687:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:2.0:1789601503.016706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:2.0:1789601503.016726:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898319616:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601503.016751:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898319616:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.016757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:2.0:1789601503.016768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:2.0:1789601503.016774:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898319488:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601503.016795:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898319488:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 21us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.016800:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00080000:2.0:1789601503.016818:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601503.016822:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601503.017888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319744 00000100:00100000:2.0:1789601503.017897:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319744 00000100:00100000:2.0:1789601503.017944:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1789601503.017951:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898319744:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601503.017994:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898319744:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.018001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00080000:1.0:1789601503.018846:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601503.557900:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601503.558007:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601503.558828:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332032 00000100:00100000:1.0:1789601503.558843:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332032 00000100:00100000:1.0:1789601503.558914:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601503.558927:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918332032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601503.558959:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601503.559037:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918332032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601503.559045:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789601503.559065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601503.559100:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376f100 x1876532918332032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601503.559118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601503.562426:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601503.562453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601503.562521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601503.562678:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332160 00000100:00100000:2.0:1789601503.562686:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332160 00000100:00100000:2.0:1789601503.562759:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601503.562795:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918332160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601503.562817:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601503.562870:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918332160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.562877:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789601503.563050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601503.563159:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cdf80 x1876532918332160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601503.563188:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601503.585691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.587840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898319872 00000100:00100000:0.0:1789601503.587864:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898319872 00000100:00100000:0.0:1789601503.587968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 319 00000100:00100000:0.0:1789601503.587981:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:6189:x1876532898319872:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601503.588005:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601503.588032:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.588069:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.588083:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.588094:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467400, rc 0) 00000100:00100000:0.0:1789601503.588186:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898319872:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 208us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.588194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 319 00000100:00100000:0.0:1789601503.591131:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601503.591470:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320000 00000100:00100000:2.0:1789601503.591483:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320000 00000100:00100000:1.0:1789601503.591647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 320 00000100:00100000:1.0:1789601503.591672:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898320000:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601503.591854:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898320000:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 193us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601503.591875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 320 00000100:00100000:2.0:1789601503.600692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.600814:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320128 00000100:00100000:0.0:1789601503.600824:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320128 00000100:00100000:0.0:1789601503.600883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 321 00000100:00100000:0.0:1789601503.600952:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898320128:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.601106:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898320128:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 214us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.601114:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 321 00000100:00100000:2.0:1789601503.606332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601503.606829:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320256 00000100:00100000:1.0:1789601503.606838:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320256 00000100:00100000:1.0:1789601503.606903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 322 00000100:00100000:1.0:1789601503.606915:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898320256:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601503.606931:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601503.606948:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a5d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.606977:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.606987:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.606996:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601503.607053:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898320256:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 140us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601503.607060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 322 00000100:00100000:1.0:1789601503.611079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.611181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320384 00000100:00100000:0.0:1789601503.611191:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320384 00000100:00100000:0.0:1789601503.611278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 323 00000100:00100000:0.0:1789601503.611288:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898320384:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.611449:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898320384:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 162us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.611456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 323 00000100:00100000:2.0:1789601503.618277:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601503.618463:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320512 00000100:00100000:0.0:1789601503.618472:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320512 00000100:00100000:0.0:1789601503.619912:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 324 00000100:00100000:0.0:1789601503.619929:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898320512:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.620077:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898320512:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 155us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.620085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 324 10000000:01000000:0.0:1789601503.886963:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601503.886973:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df501e60000 from 7 10000000:01000000:0.0:1789601503.886978:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601503.887028:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.887059:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.887070:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601503.887098:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.887163:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.887218:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.890093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332288 00000100:00100000:2.0:1789601503.890108:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332288 00000100:00100000:2.0:1789601503.890166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789601503.890177:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918332288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601503.890195:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601503.890214:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f166e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.890241:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f166e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.890252:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f166e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.890273:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382600, rc 0) 00000100:00100000:2.0:1789601503.890343:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.890374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:1.0:1789601503.890534:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601503.890690:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601503.890719:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.890729:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.890814:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601503.890848:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601503.890882:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8ba1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.891066:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332416 00000100:00100000:2.0:1789601503.891072:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332416 00000100:00100000:2.0:1789601503.891106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789601503.891114:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.891223:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.891230:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789601503.891274:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.891302:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.891343:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601503.891375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332544 00000100:00100000:2.0:1789601503.891379:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332544 00000100:00100000:2.0:1789601503.891404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789601503.891410:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.891476:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.891482:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789601503.891513:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.891526:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789601503.894265:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789601503.899546:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789601503.899676:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601503.899688:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.899722:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601503.899851:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601503.899854:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f70a3000 from 7 10000000:01000000:3.0:1789601503.899857:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601503.899893:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.899901:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.899912:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.899937:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601503.900004:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601503.900045:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.900122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332672 00000100:00100000:2.0:1789601503.900129:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332672 00000100:00100000:2.0:1789601503.900174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789601503.900183:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918332672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601503.900196:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601503.900207:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f167c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.900227:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f167c expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.900236:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f167c expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.900243:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:2.0:1789601503.900298:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918332672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.900304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789601503.900387:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601503.900403:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.900412:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601503.900468:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.900496:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.900518:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.900735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332800 00000100:00100000:2.0:1789601503.900740:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332800 00000100:00100000:2.0:1789601503.900768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789601503.900774:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918332800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.900871:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918332800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.900891:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789601503.900958:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.900985:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.901023:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.901044:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.901083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918332928 00000100:00100000:2.0:1789601503.901087:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918332928 00000100:00100000:2.0:1789601503.901113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789601503.901120:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918332928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.901194:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918332928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.901200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789601503.901237:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918332928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601503.902622:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789601503.902798:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789601503.902822:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601503.902842:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.902852:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601503.902862:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601503.902865:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f8b56000 from 7 10000000:01000000:0.0:1789601503.902867:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601503.902896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.902904:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.902914:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601503.902934:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.902985:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.903013:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.903600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333056 00000100:00100000:2.0:1789601503.903607:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333056 00000100:00100000:2.0:1789601503.903646:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789601503.903653:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918333056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601503.903665:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601503.903678:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f168a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.903699:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f168a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.903720:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f168a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.903728:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601503.903777:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.903795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789601503.903838:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601503.903851:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.903860:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601503.903916:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.903943:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601503.903962:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601503.908435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333184 00000100:00100000:0.0:1789601503.908450:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333184 00000100:00100000:0.0:1789601503.908503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789601503.908511:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.908672:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.908679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789601503.908848:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.908897:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601503.908943:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601503.908982:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601503.909184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333312 00000100:00100000:0.0:1789601503.909197:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333312 00000100:00100000:0.0:1789601503.909230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789601503.909237:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.909334:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.909342:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789601503.911185:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601503.912339:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789601503.912504:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789601503.912526:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601503.912537:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.912550:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601503.912592:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601503.912594:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4d017d800 from 7 10000000:01000000:0.0:1789601503.912597:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601503.912631:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.912640:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601503.912649:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601503.912672:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.912748:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.912780:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601503.913129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333440 00000100:00100000:3.0:1789601503.913136:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333440 00000100:00100000:3.0:1789601503.913180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789601503.913197:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918333440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601503.913212:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601503.913224:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1698 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.913246:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.913264:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.913273:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362800, rc 0) 00000100:00100000:3.0:1789601503.913316:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918333440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601503.913322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789601503.914334:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601503.914470:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.914483:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.914684:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601503.914743:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601503.914807:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601503.919634:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333568 00000100:00100000:0.0:1789601503.919666:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333568 00000100:00100000:0.0:1789601503.919735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789601503.919746:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918333568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.920532:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918333568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 786us (5786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.920541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789601503.921036:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601503.921098:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601503.930998:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601503.931096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333696 00000100:00100000:3.0:1789601503.931100:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601503.931106:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333696 00000100:00100000:0.0:1789601503.931174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789601503.931184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918333696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601503.931365:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918333696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (10194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601503.931372:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789601503.931700:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918333696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601503.932653:0:13225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789601503.932925:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789601503.932951:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601503.932961:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.932972:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601504.599583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601504.599609:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918333824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601504.599675:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601504.599804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333824 00000100:00100000:1.0:1789601504.599813:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333824 00000100:00100000:1.0:1789601504.599867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789601504.599876:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918333824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601504.599911:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601504.599963:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918333824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601504.599970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789601504.600016:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918333824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601504.901756:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601505.103060:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918333952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601505.103138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601505.103616:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918333952 00000100:00100000:2.0:1789601505.103625:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918333952 00000100:00100000:2.0:1789601505.103716:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789601505.103727:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918333952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601505.103772:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601505.103827:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918333952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601505.103834:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789601505.103883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918333952:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601505.926635:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601506.630095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918334080:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.630223:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.630383:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918334464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.630416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.630462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918334976:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.630486:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.630499:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918335488:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.630514:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.630535:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789601506.630538:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918334336:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.630553:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.630855:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918334592:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.630886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918334208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.630909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.630929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918334720:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.630948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.630973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918335232:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.630990:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.631017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334464 00000100:00100000:3.0:1789601506.631023:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334464 00000100:00100000:3.0:1789601506.631056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334208 00000100:00100000:3.0:1789601506.631058:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334208 00000100:00100000:3.0:1789601506.631067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334720 00000100:00100000:3.0:1789601506.631069:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334720 00000100:00100000:3.0:1789601506.631089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335232 00000100:00100000:3.0:1789601506.631092:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335232 00000100:00100000:3.0:1789601506.631124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789601506.631132:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918334464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631196:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918334464:12345-0@lo:400:kworker.0 Request processed in 64us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.631203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789601506.631221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789601506.631227:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918334208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631254:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918334208:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.631258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789601506.631266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789601506.631269:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918334720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631284:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918334720:12345-0@lo:400:kworker.0 Request processed in 15us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.631288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789601506.631293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789601506.631296:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918335232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631309:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918335232:12345-0@lo:400:kworker.0 Request processed in 12us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.631312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1789601506.631326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601506.631346:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918334208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918334720:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.631358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918335232:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.631545:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918334848:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.631587:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.631602:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918335360:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.631622:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601506.631648:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918334464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.631669:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334848 00000100:00100000:2.0:1789601506.631673:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334848 00000100:00100000:2.0:1789601506.631706:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335360 00000100:00100000:2.0:1789601506.631717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335360 00000100:00100000:2.0:1789601506.631735:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789601506.631741:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.631939:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334080 00000100:00100000:0.0:1789601506.631945:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334080 00000100:00100000:0.0:1789601506.631975:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789601506.631982:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918334080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632020:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918334080:12345-0@lo:400:kworker.0 Request processed in 39us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601506.632026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789601506.632060:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334976 00000100:00100000:0.0:1789601506.632064:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334976 00000100:00100000:2.0:1789601506.632070:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918334848:12345-0@lo:400:kworker.0 Request processed in 330us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601506.632077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789601506.632092:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335488 00000100:00100000:2.0:1789601506.632093:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789601506.632095:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335488 00000100:00100000:2.0:1789601506.632099:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918335360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.632124:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918335360:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601506.632129:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601506.632130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789601506.632136:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918334976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632167:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918334976:12345-0@lo:400:kworker.0 Request processed in 32us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601506.632180:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789601506.632192:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789601506.632198:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f776c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632238:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f776c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918335488:12345-0@lo:400:kworker.0 Request processed in 40us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601506.632243:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601506.632267:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334336 00000100:00100000:3.0:1789601506.632271:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334336 00000100:00100000:3.0:1789601506.632297:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789601506.632303:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918334336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.632334:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918334336:12345-0@lo:400:kworker.0 Request processed in 31us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.632339:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789601506.632359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601506.632362:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601506.632364:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601506.632373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.632395:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918335104:0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.632417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601506.632428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918335616:0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632429:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335104 00000100:00100000:0.0:1789601506.632432:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335104 00000100:00100000:3.0:1789601506.632445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601506.632454:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335616 00000100:00100000:0.0:1789601506.632457:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335616 00000100:00100000:3.0:1789601506.632463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918334080:0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632469:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601506.632474:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918335104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.632485:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918334592 00000100:00100000:3.0:1789601506.632488:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918334592 00000100:00100000:3.0:1789601506.632505:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789601506.632505:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918335104:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.632511:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918334592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.632511:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601506.632521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789601506.632526:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918335616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601506.632541:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918334592:12345-0@lo:400:kworker.0 Request processed in 30us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.632547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789601506.632547:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918335616:12345-0@lo:400:kworker.0 Request processed in 22us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.632589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918334592:0@lo:400:kworker.0 00010000:00080000:3.0:1789601506.632600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3ad80 x1876532918335104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601506.632622:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918335104:0@lo:400:kworker.0 00010000:00080000:3.0:1789601506.632635:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3b100 x1876532918335616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601506.632642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918335616:0@lo:400:kworker.0 00000100:00100000:2.0:1789601506.632731:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918334336:0@lo:400:kworker.0 00010000:00080000:2.0:1789601506.632742:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265180 x1876532918334848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601506.632824:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918334848:0@lo:400:kworker.0 00010000:00080000:2.0:1789601506.632838:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3bb80 x1876532918335360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601506.632845:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918335360:0@lo:400:kworker.0 00010000:00080000:2.0:1789601506.632855:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2267800 x1876532918334976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601506.632863:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918334976:0@lo:400:kworker.0 00010000:00080000:2.0:1789601506.632872:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1a3b800 x1876532918335488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601506.632879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918335488:0@lo:400:kworker.0 00000100:00100000:0.0:1789601506.633934:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789601506.633992:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601506.633996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789601506.859885:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789601506.949796:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601507.144036:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918335744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601507.144105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601507.145084:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918335872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601507.145123:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601507.145168:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335744 00000100:00100000:3.0:1789601507.145175:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335744 00000100:00100000:3.0:1789601507.145220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918335872 00000100:00100000:3.0:1789601507.145223:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918335872 00000100:00100000:3.0:1789601507.145236:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601507.145243:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918335744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601507.145267:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601507.145307:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918335744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601507.145313:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601507.145330:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789601507.145336:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918335872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601507.145346:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601507.145371:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918335872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601507.145376:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789601507.145421:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376df80 x1876532918335872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601507.145438:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918335872:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789601507.145467:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c376ed80 x1876532918335744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601507.145479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918335744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601507.973882:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601508.130003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601508.130470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601508.139082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601508.139118:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601508.139306:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320640 00000100:00100000:2.0:1789601508.139316:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320640 00000100:00100000:1.0:1789601508.139394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320768 00000100:00100000:1.0:1789601508.139401:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320768 00000100:00100000:1.0:1789601508.139447:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321024 00000100:00100000:1.0:1789601508.139451:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321024 00000100:00100000:1.0:1789601508.139477:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:1.0:1789601508.139486:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898320768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601508.139571:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898320768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (9560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.139594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:1.0:1789601508.139612:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:1.0:1789601508.139618:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601508.139646:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (9177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.139652:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:2.0:1789601508.141631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 338 00000100:00100000:2.0:1789601508.141652:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898320640:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601508.141730:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898320640:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 87us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.141737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 338 00000100:00080000:0.0:1789601508.141902:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601508.144483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601508.144643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898320896 00000100:00100000:0.0:1789601508.144654:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898320896 00000100:00100000:0.0:1789601508.144733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321152 00000100:00100000:0.0:1789601508.144736:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321152 00000100:00080000:2.0:1789601508.144808:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601508.144858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:0.0:1789601508.144868:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898320896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601508.144944:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898320896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 79us (5825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601508.144951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:0.0:1789601508.144968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:0.0:1789601508.144975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601508.144999:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601508.145005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:2.0:1789601508.678404:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918336000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601508.678477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601508.678873:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336000 00000100:00100000:1.0:1789601508.678883:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336000 00000100:00100000:1.0:1789601508.678961:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789601508.678971:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918336000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601508.679003:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601508.679052:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918336000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.679069:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1789601508.679198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789601508.679235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265180 x1876532918336000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601508.679267:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918336000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601508.681438:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918336128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601508.681507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601508.681656:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336128 00000100:00100000:0.0:1789601508.681665:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336128 00000100:00100000:0.0:1789601508.681732:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601508.681740:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918336128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601508.681760:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789601508.681780:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601508.681812:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918336128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601508.681818:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789601508.681848:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cea00 x1876532918336128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601508.681867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918336128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789601509.000103:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601509.701925:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918336256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601509.701999:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601509.702219:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336256 00000100:00100000:2.0:1789601509.702228:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336256 00000100:00100000:2.0:1789601509.702286:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789601509.702296:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918336256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601509.702330:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601509.702490:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918336256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.702498:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789601509.705585:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918336256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601510.023260:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601510.213881:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918336384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601510.213952:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601510.214148:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336384 00000100:00100000:2.0:1789601510.214158:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336384 00000100:00100000:2.0:1789601510.214224:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789601510.214233:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918336384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601510.214265:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601510.214318:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918336384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601510.214325:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601510.216169:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918336384:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789601511.046140:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601511.751253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918336768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751364:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918337280:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751496:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918337792:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751531:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751575:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789601511.751582:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918336640:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751603:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918337152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751636:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918337664:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751683:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601511.751717:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337280 00000100:00100000:1.0:1789601511.751727:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337280 00000100:00100000:1.0:1789601511.751783:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337792 00000100:00100000:1.0:1789601511.751787:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337792 00000100:00100000:1.0:1789601511.751803:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336640 00000100:00100000:1.0:1789601511.751805:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336640 00000100:00100000:1.0:1789601511.751817:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337152 00000100:00100000:1.0:1789601511.751820:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337152 00000100:00100000:1.0:1789601511.751833:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337664 00000100:00100000:1.0:1789601511.751836:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337664 00000100:00100000:1.0:1789601511.751851:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789601511.751860:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918337280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751923:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918337280:12345-0@lo:400:kworker.0 Request processed in 62us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.751931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789601511.751949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789601511.751956:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918337792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.751983:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918337792:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.751999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789601511.752012:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789601511.752018:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918336640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.752047:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918336640:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.752058:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789601511.752070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789601511.752076:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.752104:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918337152:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.752110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789601511.752121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789601511.752127:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918337664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.752154:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918337664:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.752160:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789601511.752206:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918336640:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.752217:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918337152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601511.752227:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918337664:0@lo:400:kworker.0 00010000:00080000:1.0:1789601511.752241:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8944700 x1876532918337280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601511.752252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918337280:0@lo:400:kworker.0 00010000:00080000:1.0:1789601511.752262:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f7385880 x1876532918337792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601511.752279:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918337792:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752604:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336768 00000100:00100000:2.0:1789601511.752610:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336768 00000100:00100000:2.0:1789601511.752664:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789601511.752672:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918336768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752725:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918336768:12345-0@lo:400:kworker.0 Request processed in 54us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601511.752730:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789601511.752752:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601511.752757:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601511.752780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918336768:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918336512:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.752882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918337024:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752907:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.752929:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918337536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.752975:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f7384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918338048:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.752996:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.753017:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789601511.753023:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918336896:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.753060:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.753080:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918337408:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.753100:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.753121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f7387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918337920:0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.753147:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601511.753176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337024 00000100:00100000:2.0:1789601511.753181:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337024 00000100:00100000:2.0:1789601511.753208:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789601511.753215:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918337024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601511.753255:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918337024:12345-0@lo:400:kworker.0 Request processed in 40us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601511.753262:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789601511.753399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336896 00000100:00100000:3.0:1789601511.753405:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336896 00000100:00100000:3.0:1789601511.753935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789601511.753944:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918336896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601511.753992:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918336896:12345-0@lo:400:kworker.0 Request processed in 49us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601511.754013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789601511.754040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918336512 00000100:00100000:3.0:1789601511.754044:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918336512 00000100:00100000:0.0:1789601511.754298:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337536 00000100:00100000:0.0:1789601511.754303:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337536 00000100:00100000:0.0:1789601511.754342:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338048 00000100:00100000:0.0:1789601511.754346:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338048 00000100:00100000:0.0:1789601511.754361:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337408 00000100:00100000:0.0:1789601511.754363:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337408 00000100:00100000:0.0:1789601511.754378:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918337920 00000100:00100000:0.0:1789601511.754388:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918337920 00000100:00100000:0.0:1789601511.754408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601511.754415:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601511.754597:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918337536:12345-0@lo:400:kworker.0 Request processed in 182us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.754604:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601511.754620:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789601511.754627:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918338048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601511.754668:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918338048:12345-0@lo:400:kworker.0 Request processed in 43us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.754675:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789601511.754686:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601511.754692:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918337408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601511.754720:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918337408:12345-0@lo:400:kworker.0 Request processed in 28us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.754726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601511.754738:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789601511.754744:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601511.754771:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918337920:12345-0@lo:400:kworker.0 Request processed in 28us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.754776:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789601511.754799:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601511.754804:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601511.755333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789601511.755346:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918336512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601511.755389:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918336512:12345-0@lo:400:kworker.0 Request processed in 48us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601511.755395:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789601511.767767:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918336896:0@lo:400:kworker.0 00010000:00080000:3.0:1789601511.767796:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8947800 x1876532918337408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601511.767809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918337408:0@lo:400:kworker.0 00010000:00080000:3.0:1789601511.767828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f7387800 x1876532918337920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601511.767838:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f7387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918337920:0@lo:400:kworker.0 00000100:00100000:3.0:1789601511.767854:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918336512:0@lo:400:kworker.0 00000100:00100000:3.0:1789601511.767868:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918337024:0@lo:400:kworker.0 00010000:00080000:3.0:1789601511.767883:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8944380 x1876532918337536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601511.767892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918337536:0@lo:400:kworker.0 00010000:00080000:3.0:1789601511.767907:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f7384e00 x1876532918338048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601511.767933:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f7384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918338048:0@lo:400:kworker.0 00010000:00010000:2.0:1789601512.079597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601512.262114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918338176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601512.262220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601512.262413:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918338304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601512.262447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601512.262513:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338176 00000100:00100000:1.0:1789601512.262525:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338176 00000100:00100000:1.0:1789601512.262598:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338304 00000100:00100000:1.0:1789601512.262601:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338304 00000100:00100000:1.0:1789601512.262617:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789601512.262627:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918338176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601512.262700:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601512.262753:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918338176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601512.262761:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789601512.262780:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789601512.262787:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918338304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601512.262798:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601512.262823:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918338304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601512.262829:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1789601512.262924:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265c00 x1876532918338176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789601512.267103:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f7385880 x1876532918338304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601512.267155:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918338304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601512.267595:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918338176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601513.099936:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601513.106475:0:13539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:31:51 (1789601511) === 00000100:00100000:2.0:1789601513.254458:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.254513:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.254542:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.254605:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.254669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.254699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321536 00000100:00100000:2.0:1789601513.254710:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321536 00000100:00100000:2.0:1789601513.254765:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321792 00000100:00100000:2.0:1789601513.254780:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321792 00000100:00100000:2.0:1789601513.254798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321408 00000100:00100000:2.0:1789601513.254800:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321408 00000100:00100000:2.0:1789601513.254811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321664 00000100:00100000:2.0:1789601513.254813:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321664 00000100:00100000:2.0:1789601513.254827:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:2.0:1789601513.254836:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898321536:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601513.254903:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898321536:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.254910:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:2.0:1789601513.254927:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:2.0:1789601513.254932:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321792:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601513.254954:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321792:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.254960:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:2.0:1789601513.254971:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:2.0:1789601513.254978:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898321408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601513.255000:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898321408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.255006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:2.0:1789601513.255017:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:2.0:1789601513.255024:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321664:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601513.255046:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898321664:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.255051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00080000:2.0:1789601513.255077:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601513.255082:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601513.255479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321280 00000100:00100000:1.0:1789601513.255485:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321280 00000100:00100000:1.0:1789601513.255518:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 340 00000100:00100000:1.0:1789601513.255525:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898321280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601513.255574:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898321280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601513.255581:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 340 00000100:00100000:2.0:1789601513.404424:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.404648:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601513.406090:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322048 00000100:00100000:1.0:1789601513.406122:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322048 00000100:00100000:1.0:1789601513.406195:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:1.0:1789601513.406205:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:af09a131-8cce-462c-8c01-5d48daa688cf+6:10531:x1876532898322048:12345-192.168.203.48@tcp:700:mkdir.0 00000100:00100000:1.0:1789601513.406472:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:af09a131-8cce-462c-8c01-5d48daa688cf+6:10531:x1876532898322048:12345-192.168.203.48@tcp:700:mkdir.0 Request processed in 267us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601513.406480:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789601513.407861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898321920 00000100:00100000:0.0:1789601513.407871:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898321920 00000100:00100000:0.0:1789601513.407984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789601513.407995:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898321920:12345-192.168.203.48@tcp:41:mkdir.0 00000004:00000024:0.0:1789601513.408029:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601513.408120:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898321920:12345-192.168.203.48@tcp:41:mkdir.0 Request processed in 127us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601513.408127:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789601513.412665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.422447:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322304 00000100:00100000:2.0:1789601513.422463:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322304 00000100:00100000:2.0:1789601513.422656:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789601513.422668:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:10531:x1876532898322304:12345-192.168.203.48@tcp:36:mkdir.0 00010000:00010000:2.0:1789601513.422731:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601513.422813:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1548 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d1 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.422836:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9d00) 00010000:00010000:2.0:1789601513.422847:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601513.422942:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.422967:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.422980:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.423008:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.423016:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.423022:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429360:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429385:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429396:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601513.429414:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bd0320a reply state 000000009230f255 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429424:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429431:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:2.0:1789601513.429434:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601513.429438:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789601513.429444:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789601513.429452:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.429458:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432780:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432806:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601513.432813:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432847:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432864:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:2.0:1789601513.432868:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601513.432873:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432880:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f16a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601513.432911:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bd0320a reply state 000000009230f255 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432922:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.432929:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4c4dbc500) 00010000:00010000:2.0:1789601513.432931:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601513.432936:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789601513.433139:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:10531:x1876532898322304:12345-192.168.203.48@tcp:36:mkdir.0 Request processed in 10469us (20480us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789601513.433149:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1789601513.457006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.457137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322432 00000100:00100000:3.0:1789601513.457148:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322432 00000100:00100000:3.0:1789601513.457225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:3.0:1789601513.457237:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:10532:x1876532898322432:12345-192.168.203.48@tcp:101:chmod.0 00010000:00010000:3.0:1789601513.457263:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.457291:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a64 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457356:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457370:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457381:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.457427:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601513.457430:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601513.457467:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457494:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a64 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457531:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a64 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.457540:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f5eb2a00) 00010000:00010000:3.0:1789601513.457543:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601513.457546:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362e00, rc 0) 00000100:00100000:3.0:1789601513.457792:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:10532:x1876532898322432:12345-192.168.203.48@tcp:101:chmod.0 Request processed in 556us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.457800:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:3.0:1789601513.461626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.461822:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322688 00000100:00100000:2.0:1789601513.461832:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322688 00000100:00100000:2.0:1789601513.461886:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789601513.461896:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:10532:x1876532898322688:12345-192.168.203.48@tcp:36:chmod.0 00010000:00010000:2.0:1789601513.461947:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601513.461982:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a64 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.462017:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f5eb2a00) 00010000:00010000:2.0:1789601513.462029:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601513.462054:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.462066:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.462076:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601513.462287:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d58f5cd reply state 00000000ebbca75c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.462300:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.462307:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:2.0:1789601513.462309:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789601513.462312:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789601513.462320:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789601513.462409:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:10532:x1876532898322688:12345-192.168.203.48@tcp:36:chmod.0 Request processed in 513us (793us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789601513.462416:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789601513.508489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.508591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322816 00000100:00100000:3.0:1789601513.508600:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322816 00000100:00100000:3.0:1789601513.508680:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789601513.508692:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:10533:x1876532898322816:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:3.0:1789601513.508727:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.508749:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f16d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a6b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.508820:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.508836:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.508848:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.508917:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601513.508920:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601513.508956:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.508981:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f16d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a6b expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.508999:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a6b expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.509007:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:3.0:1789601513.509009:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601513.509013:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363800, rc 0) 00000100:00100000:3.0:1789601513.509080:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+10:10533:x1876532898322816:12345-192.168.203.48@tcp:101:chown.0 Request processed in 391us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.509087:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789601513.513967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.517611:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898322944 00000100:00100000:2.0:1789601513.517644:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898322944 00000100:00100000:3.0:1789601513.521416:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1789601513.521430:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+10:10533:x1876532898322944:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:3.0:1789601513.521452:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.521475:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a72 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521540:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521593:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521604:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521877:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521887:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521894:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521967:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521975:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.521982:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.522028:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601513.522032:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601513.522050:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522063:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522080:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522086:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522091:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.522096:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522103:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522113:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:3.0:1789601513.522116:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601513.522120:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522126:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f16e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522140:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522361:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522371:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522376:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.522386:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522392:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522401:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4c4dbc500) 00010000:00010000:3.0:1789601513.522404:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601513.522407:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522414:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522452:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f16de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a72 expref: 12 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522467:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a72 expref: 11 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.522473:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:3.0:1789601513.522475:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601513.522478:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528e00, rc 0) 00000100:00100000:3.0:1789601513.522600:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+11:10533:x1876532898322944:12345-192.168.203.48@tcp:101:chown.0 Request processed in 1172us (8641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.522609:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1789601513.525161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.525285:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898323072 00000100:00100000:3.0:1789601513.525295:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898323072 00000100:00100000:3.0:1789601513.525357:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789601513.525368:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af09a131-8cce-462c-8c01-5d48daa688cf+11:10533:x1876532898323072:12345-192.168.203.48@tcp:900:chown.0 00000100:00100000:3.0:1789601513.525466:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af09a131-8cce-462c-8c01-5d48daa688cf+11:10533:x1876532898323072:12345-192.168.203.48@tcp:900:chown.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.525475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789601513.530823:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.530913:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898323328 00000100:00100000:3.0:1789601513.530924:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898323328 00000100:00100000:3.0:1789601513.530978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1789601513.530988:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:10533:x1876532898323328:12345-192.168.203.48@tcp:36:chown.0 00010000:00010000:3.0:1789601513.531043:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601513.531068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f16f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a72 expref: 11 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.531089:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:3.0:1789601513.531094:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601513.531115:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.531128:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.531137:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601513.537506:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1789601513.537642:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c76d2814 reply state 000000003277a3d5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.537663:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.537672:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:3.0:1789601513.537685:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789601513.537691:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601513.537703:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1789601513.537792:0:6523:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789601513.537816:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:10533:x1876532898323328:12345-192.168.203.48@tcp:36:chown.0 Request processed in 6825us (6998us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789601513.537826:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00010000:00010000:1.0:1789601513.537933:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537943:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537950:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537957:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601513.537961:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537969:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537979:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:1.0:1789601513.537982:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789601513.537986:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.537992:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f16fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546382:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546418:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546427:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546432:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601513.546437:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546444:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546462:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4c4dbc500) 00010000:00010000:2.0:1789601513.546465:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601513.546470:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546478:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f16ad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546502:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546507:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546512:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546517:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601513.546525:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546531:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546538:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c4dbc800) 00010000:00010000:2.0:1789601513.546541:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601513.546543:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546548:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f16b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546579:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546585:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546590:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546595:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601513.546597:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546601:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546607:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:2.0:1789601513.546609:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601513.546619:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.546625:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f16c9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601513.557630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.557729:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898323456 00000100:00100000:3.0:1789601513.557741:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898323456 00000100:00100000:3.0:1789601513.557794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789601513.557805:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:10534:x1876532898323456:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:3.0:1789601513.557828:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.557847:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a79 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601513.561194:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3291us 00010000:00010000:0.0:1789601513.590314:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590338:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590351:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590368:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590376:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590383:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590506:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590521:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601513.590551:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789601513.590582:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601513.590619:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590641:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590649:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590656:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590661:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601513.590665:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590673:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590685:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:0.0:1789601513.590694:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601513.590700:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590707:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590718:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590724:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590730:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590735:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601513.590738:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590744:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590752:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4c99bb700) 00010000:00010000:0.0:1789601513.590755:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601513.590757:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f170f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590798:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a79 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590826:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a79 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.590833:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:0.0:1789601513.590836:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789601513.590838:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601513.590907:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:10534:x1876532898323456:12345-192.168.203.48@tcp:101:touch.500 Request processed in 33103us (33285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601513.590916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789601513.594288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.594515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898323712 00000100:00100000:2.0:1789601513.594525:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898323712 00000100:00100000:2.0:1789601513.594612:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:2.0:1789601513.594623:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:10534:x1876532898323712:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:2.0:1789601513.594660:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601513.594681:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f171d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a80 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594786:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594801:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594811:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594826:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594833:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.594839:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601513.595440:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789601513.595648:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f1732 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595659:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f1732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595667:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f1732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595700:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595708:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595714:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595719:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601513.595723:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595730:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:2.0:1789601513.595743:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601513.595747:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595765:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1724 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601513.595782:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fdaa51b reply state 0000000074c785ac transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595793:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595799:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x83325275 (ffff8df4c4dbc800) 00010000:00010000:2.0:1789601513.595801:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601513.595803:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789601513.595835:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f171d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a80 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595849:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f1732 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a80 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.595856:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4c4dbc500) 00010000:00010000:2.0:1789601513.595858:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601513.595860:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383600, rc 0) 00000100:00100000:2.0:1789601513.595977:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+10:10534:x1876532898323712:12345-192.168.203.48@tcp:101:touch.500 Request processed in 1355us (1695us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789601513.595986:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:0.0:1789601513.615735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.615833:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898323968 00000100:00100000:3.0:1789601513.615845:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898323968 00000100:00100000:3.0:1789601513.615904:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1789601513.615914:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+10:10534:x1876532898323968:12345-192.168.203.48@tcp:36:touch.500 00010000:00010000:3.0:1789601513.615971:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601513.615997:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f1732 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a80 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.616016:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4c4dbc500) 00010000:00010000:3.0:1789601513.616025:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601513.616085:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.616097:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.616121:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601513.616232:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c254858b reply state 000000008e20cd90 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.616245:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.616251:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:3.0:1789601513.616254:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601513.616256:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601513.616353:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+11:10534:x1876532898323968:12345-192.168.203.48@tcp:36:touch.500 Request processed in 440us (629us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789601513.616361:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789601513.622754:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.622839:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324096 00000100:00100000:3.0:1789601513.622849:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324096 00000100:00100000:3.0:1789601513.622904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1789601513.622915:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:10534:x1876532898324096:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:3.0:1789601513.622939:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.622959:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1747 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a87 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.623017:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a87 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.623031:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a87 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.623074:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:3.0:1789601513.623077:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601513.623081:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601513.623141:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+12:10534:x1876532898324096:12345-192.168.203.48@tcp:101:touch.500 Request processed in 227us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.623158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:2.0:1789601513.626139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.626248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324224 00000100:00100000:0.0:1789601513.626257:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324224 00000100:00100000:0.0:1789601513.626310:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601513.626318:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2414:x1876532898324224:12345-192.168.203.48@tcp:8:touch.500 00010000:00080000:0.0:1789601513.626350:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:0.0:1789601513.626379:0:8440:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f174e 00002000:00100000:0.0:1789601513.626391:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af09a131-8cce-462c-8c01-5d48daa688cf/ffff8df3c3549000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601513.626407:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601513.626479:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601513.626506:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8df3c354e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601513.626620:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898324224:12345-192.168.203.48@tcp:8:touch.500 Request processed in 301us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601513.626627:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601513.630677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.630779:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324352 00000100:00100000:3.0:1789601513.630789:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324352 00000100:00100000:3.0:1789601513.630866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:3.0:1789601513.630876:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898324352:12345-192.168.203.48@tcp:2:touch.500 00000100:00080000:2.0:1789601513.631077:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789601513.642823:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1789601513.642838:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000100:00100000:3.0:1789601513.643666:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:0:x1876532898324352:12345-192.168.203.48@tcp:2:touch.500 Request processed in 12269us (12476us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789601513.643678:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:1.0:1789601513.647433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.647533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324608 00000100:00100000:2.0:1789601513.647544:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324608 00000100:00100000:2.0:1789601513.647659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601513.647670:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+12:10534:x1876532898324608:12345-192.168.203.48@tcp:35:touch.500 00000100:00100000:2.0:1789601513.647998:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+13:10534:x1876532898324608:12345-192.168.203.48@tcp:35:touch.500 Request processed in 328us (574us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789601513.648006:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601513.673242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.673331:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324736 00000100:00100000:3.0:1789601513.673358:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324736 00000100:00100000:3.0:1789601513.673429:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1789601513.673441:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+13:10535:x1876532898324736:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:3.0:1789601513.673467:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.673489:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a8e expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673610:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673625:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673662:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.673706:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601513.673710:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601513.673745:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673771:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a8e expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673789:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a8e expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.673798:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:3.0:1789601513.673800:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601513.673804:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528800, rc 0) 00000100:00100000:3.0:1789601513.673855:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:10535:x1876532898324736:12345-192.168.203.48@tcp:101:rm.0 Request processed in 416us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.673862:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1789601513.681013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.681238:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898324992 00000100:00100000:0.0:1789601513.681257:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898324992 00000100:00100000:0.0:1789601513.681341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:0.0:1789601513.681352:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+14:10535:x1876532898324992:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:0.0:1789601513.681373:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601513.681392:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a95 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601513.681489:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789601513.681706:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1763 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a95 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.681721:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:0.0:1789601513.681724:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601513.681729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a95 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.681744:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466400, rc 0) 00000100:00100000:0.0:1789601513.681819:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+15:10535:x1876532898324992:12345-192.168.203.48@tcp:101:rm.0 Request processed in 469us (821us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1789601513.681827:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:1.0:1789601513.690722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601513.690798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898325120 00000100:00100000:2.0:1789601513.690814:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898325120 00000100:00100000:2.0:1789601513.690913:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601513.690924:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:10535:x1876532898325120:12345-192.168.203.48@tcp:37:rm.0 00000100:00100000:2.0:1789601513.697114:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:10535:x1876532898325120:12345-192.168.203.48@tcp:37:rm.0 Request processed in 6180us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.697129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1789601513.715859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.715985:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898325376 00000100:00100000:0.0:1789601513.715999:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898325376 00000100:00100000:0.0:1789601513.716065:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789601513.716076:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+15:10535:x1876532898325376:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:0.0:1789601513.716308:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+16:10535:x1876532898325376:12345-192.168.203.48@tcp:35:rm.0 Request processed in 233us (458us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789601513.716329:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1789601513.721729:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.721831:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898325632 00000100:00100000:3.0:1789601513.721841:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898325632 00000100:00100000:3.0:1789601513.721904:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789601513.721915:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:10535:x1876532898325632:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:3.0:1789601513.721939:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.721986:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48a9c expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.722094:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1778 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.722109:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1778 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.722121:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1778 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.722131:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789601513.722247:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a9c expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.722268:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1778 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a9c expref: 18 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.722277:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:3.0:1789601513.722281:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601513.722284:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528c00, rc 0) 00000100:00100000:3.0:1789601513.722356:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898325632:12345-192.168.203.48@tcp:101:rm.0 Request processed in 443us (637us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789601513.722363:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789601513.726132:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.726273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898325760 00000100:00100000:0.0:1789601513.726282:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898325760 00000100:00100000:0.0:1789601513.726347:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789601513.726358:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898325760:12345-192.168.203.48@tcp:41:rm.0 00000004:00000024:0.0:1789601513.726409:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789601513.726484:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898325760:12345-192.168.203.48@tcp:41:rm.0 Request processed in 128us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601513.726490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1789601513.734757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.734844:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898325888 00000100:00100000:3.0:1789601513.734855:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898325888 00000100:00100000:3.0:1789601513.734917:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1789601513.734928:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898325888:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:3.0:1789601513.734969:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.734993:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1786 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48aa3 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735060:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735074:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735084:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735095:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735102:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735108:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735193:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735203:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735210:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.735244:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789601513.735254:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601513.735275:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735288:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735296:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735302:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735309:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735314:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.735318:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735325:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735338:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:3.0:1789601513.735341:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601513.735346:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735352:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f178d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735368:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735384:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735390:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735394:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.735397:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735403:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735411:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x83325275 (ffff8df4c4dbc800) 00010000:00010000:3.0:1789601513.735414:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601513.735417:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735423:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f1794 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735448:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1786 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aa3 expref: 20 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735462:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aa3 expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.735470:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:3.0:1789601513.735472:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601513.735481:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362600, rc 0) 00000100:00100000:3.0:1789601513.735553:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:10535:x1876532898325888:12345-192.168.203.48@tcp:101:rm.0 Request processed in 627us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.735596:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1789601513.742761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.742843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898326144 00000100:00100000:0.0:1789601513.742856:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898326144 00000100:00100000:0.0:1789601513.742923:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:0.0:1789601513.742935:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+19:10535:x1876532898326144:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:0.0:1789601513.742993:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789601513.743023:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f179b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aa3 expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743045:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1747 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a87 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743057:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:0.0:1789601513.743066:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f175c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a8e expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743075:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:0.0:1789601513.743091:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601513.743112:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743124:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743134:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743144:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743151:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743157:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743250:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743258:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743265:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601513.743479:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789601513.743488:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381864930604ns, next at 382864928711ns, rc = 0 00010000:00010000:0.0:1789601513.743527:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743545:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743552:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743582:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743588:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743594:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743619:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601513.743647:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743653:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743658:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743663:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601513.743667:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743673:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743692:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:0.0:1789601513.743694:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789601513.743698:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743704:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f17b0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743720:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743726:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743731:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743736:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601513.743738:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.743743:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743922:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601513.743929:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743935:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601513.743938:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743945:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743954:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:1.0:1789601513.743957:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601513.743960:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743966:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f17b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.743988:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601513.743991:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601513.743992:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601513.746208:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:0.0:1789601513.746212:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601513.746218:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.746225:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f17a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601513.746264:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec7b3584 reply state 00000000d9d7e12a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.746275:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601513.746282:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x83325275 (ffff8df4c4dbc800) 00010000:00010000:0.0:1789601513.746283:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601513.746286:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601513.746773:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898326144:12345-192.168.203.48@tcp:36:rm.0 Request processed in 3836us (4018us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789601513.746782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789601513.765050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601513.765132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898326400 00000100:00100000:0.0:1789601513.765142:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898326400 00000100:00100000:0.0:1789601513.765206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1789601513.765216:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898326400:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:0.0:1789601513.765426:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:10535:x1876532898326400:12345-192.168.203.48@tcp:35:rm.0 Request processed in 211us (387us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789601513.765434:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789601513.777222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601513.777310:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898326656 00000100:00100000:3.0:1789601513.777320:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898326656 00000100:00100000:3.0:1789601513.777387:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789601513.777399:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:10535:x1876532898326656:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:3.0:1789601513.777481:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789601513.777509:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a9c expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777532:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a79 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777544:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4c99bbe00) 00010000:00010000:3.0:1789601513.777622:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363800/0x74872e3eca9f16d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a6b expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777641:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c4dbc400) 00010000:00010000:3.0:1789601513.777648:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601513.777673:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777685:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777694:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777720:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777728:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777736:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777813:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777821:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.777827:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601513.778063:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789601513.778078:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778086:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778093:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778099:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.778103:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778122:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778131:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df4f5eb2700) 00010000:00010000:3.0:1789601513.778134:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789601513.778138:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778145:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362600/0x74872e3eca9f17cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778164:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778172:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778179:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778183:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601513.778186:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778192:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778200:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f5eb2200) 00010000:00010000:3.0:1789601513.778203:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601513.778206:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778222:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362e00/0x74872e3eca9f17be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601513.778235:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018996d16 reply state 00000000dd11e34e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778246:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.778253:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4f5eb2800) 00010000:00010000:3.0:1789601513.778256:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601513.778258:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601513.778323:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+18:10535:x1876532898326656:12345-192.168.203.48@tcp:36:rm.0 Request processed in 925us (1108us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789601513.778331:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789601513.797876:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601513.797900:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918338432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601513.797970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601513.798277:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601513.798288:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918338560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601513.798321:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601513.798397:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338432 00000100:00100000:3.0:1789601513.798404:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338432 00000100:00100000:3.0:1789601513.798460:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338560 00000100:00100000:3.0:1789601513.798463:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338560 00000100:00100000:3.0:1789601513.798481:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789601513.798489:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918338432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601513.798509:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601513.798550:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918338432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.798574:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789601513.798607:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789601513.798613:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918338560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601513.798623:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601513.798661:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918338560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.798667:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789601513.798724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601513.798753:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2265180 x1876532918338560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601513.798771:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918338560:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789601513.798989:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73cc380 x1876532918338432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601513.799003:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918338432:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601514.117794:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601514.828062:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601514.828086:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918338688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601514.828164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601514.828362:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338688 00000100:00100000:2.0:1789601514.828370:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338688 00000100:00100000:2.0:1789601514.828422:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789601514.828432:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918338688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601514.828471:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601514.828528:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918338688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601514.828535:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601514.828726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918338688:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601515.143076:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601515.335046:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918338816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601515.335113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601515.335303:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338816 00000100:00100000:0.0:1789601515.335311:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338816 00000100:00100000:0.0:1789601515.335359:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789601515.335368:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918338816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601515.335398:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789601515.339878:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918338816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4502us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601515.339893:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789601515.340423:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918338816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789601516.165724:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601516.872997:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918338944:0@lo:400:kworker.0 00000100:00100000:0.0:1789601516.873085:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601516.873540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918338944 00000100:00100000:3.0:1789601516.873549:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918338944 00000100:00100000:1.0:1789601516.873588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918339072:0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.873638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789601516.873642:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601516.873652:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918338944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.873717:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339072 00000100:00100000:1.0:1789601516.873722:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339072 00000100:00100000:1.0:1789601516.873752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789601516.873758:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918339072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.873811:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918339072:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601516.873819:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789601516.873861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918339072:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918339328:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874665:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874686:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918339840:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874707:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918340352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874754:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789601516.874759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918339200:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918339712:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874836:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918340224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874854:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601516.874877:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339840 00000100:00100000:2.0:1789601516.874881:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339840 00000100:00100000:2.0:1789601516.874917:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340352 00000100:00100000:2.0:1789601516.874919:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340352 00000100:00100000:2.0:1789601516.874938:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789601516.874945:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918339840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.874979:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918339840:12345-0@lo:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601516.874985:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789601516.875000:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789601516.875005:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.875026:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918340352:12345-0@lo:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601516.875047:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789601516.875082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339328 00000100:00100000:2.0:1789601516.875086:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339328 00000100:00100000:2.0:1789601516.875102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339712 00000100:00100000:2.0:1789601516.875105:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339712 00000100:00100000:2.0:1789601516.875115:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340224 00000100:00100000:2.0:1789601516.875116:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340224 00000100:00100000:2.0:1789601516.875128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789601516.875133:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918339328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.875162:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918339328:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601516.875638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789601516.875660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789601516.875667:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918339712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.875702:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918339712:12345-0@lo:400:kworker.0 Request processed in 36us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601516.875707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789601516.875718:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789601516.875725:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918340224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.875747:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918340224:12345-0@lo:400:kworker.0 Request processed in 24us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601516.875751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:2.0:1789601516.875769:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601516.875773:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601516.875775:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601516.875823:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280b800 x1876532918339712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601516.875860:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918339712:0@lo:400:kworker.0 00010000:00080000:2.0:1789601516.875874:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2809180 x1876532918340224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601516.875881:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918340224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601516.875891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918339328:0@lo:400:kworker.0 00010000:00080000:2.0:1789601516.875901:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2809c00 x1876532918339840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601516.875907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918339840:0@lo:400:kworker.0 00010000:00080000:2.0:1789601516.875916:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280bb80 x1876532918340352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601516.875923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918340352:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.876750:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339200 00000100:00100000:1.0:1789601516.876759:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339200 00000100:00100000:1.0:1789601516.876825:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789601516.876834:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918339200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.876914:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918339200:12345-0@lo:400:kworker.0 Request processed in 82us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601516.876922:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789601516.876954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918339584:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.876987:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601516.877010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918340096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877030:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601516.877050:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789601516.877057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918339456:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877099:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601516.877117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918339968:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601516.877156:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918340480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601516.877530:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339968 00000100:00100000:1.0:1789601516.877536:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339968 00000100:00100000:1.0:1789601516.877608:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340480 00000100:00100000:1.0:1789601516.877621:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340480 00000100:00100000:1.0:1789601516.877638:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601516.877644:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918339968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877686:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918339968:12345-0@lo:400:kworker.0 Request processed in 42us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601516.877693:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601516.877708:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601516.877715:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918340480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.877724:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918338944:12345-0@lo:400:kworker.0 Request processed in 4072us (4635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601516.877740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789601516.877769:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918340480:12345-0@lo:400:kworker.0 Request processed in 54us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601516.877777:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601516.877809:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339584 00000100:00100000:3.0:1789601516.877815:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339584 00010000:00080000:1.0:1789601516.877826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280aa00 x1876532918339968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601516.877840:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918339968:0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.877844:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340096 00000100:00100000:3.0:1789601516.877849:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340096 00010000:00080000:1.0:1789601516.877855:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c2808a80 x1876532918340480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601516.877865:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918340480:0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.877876:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789601516.877885:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918339584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.877899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789601516.877909:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.877929:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918339584:12345-0@lo:400:kworker.0 Request processed in 45us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601516.877937:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789601516.877952:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918340096:12345-0@lo:400:kworker.0 Request processed in 45us (919us total) trans 0 rc 0/0 00000100:00080000:3.0:1789601516.877958:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601516.877962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1789601516.877964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601516.877967:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601516.877999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918339200:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.878007:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918339584:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.878024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918340096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.878045:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918339456 00000100:00100000:3.0:1789601516.878050:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918339456 00000100:00100000:3.0:1789601516.878076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789601516.878083:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918339456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601516.878125:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918339456:12345-0@lo:400:kworker.0 Request processed in 43us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601516.878132:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789601516.878424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918338944:0@lo:400:kworker.0 00000100:00100000:1.0:1789601516.878646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918339456:0@lo:400:kworker.0 00010000:00010000:0.0:1789601517.189979:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601517.382028:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601517.382054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918340608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601517.382121:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601517.382230:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340608 00000100:00100000:3.0:1789601517.382238:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340608 00000100:00100000:3.0:1789601517.382291:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789601517.382300:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918340608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601517.382327:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601517.382379:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918340608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601517.382386:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789601517.382614:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601517.382625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918340736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601517.382654:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601517.382790:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340736 00000100:00100000:1.0:1789601517.382795:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340736 00000100:00100000:1.0:1789601517.382826:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601517.382834:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918340736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601517.382854:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601517.382908:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918340736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601517.382929:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789601517.382955:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8946a00 x1876532918340736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601517.382974:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918340736:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789601517.384286:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8944e00 x1876532918340608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601517.384308:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918340608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789601518.219264:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601518.300444:0:13687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1789601518.374801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601518.374995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898326912 00000100:00100000:3.0:1789601518.375004:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898326912 00000100:00100000:3.0:1789601518.375050:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327040 00000100:00100000:3.0:1789601518.375059:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327040 00000100:00100000:3.0:1789601518.375074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327296 00000100:00100000:3.0:1789601518.375076:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327296 00000100:00100000:3.0:1789601518.375086:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327424 00000100:00100000:3.0:1789601518.375088:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327424 00000100:00100000:3.0:1789601518.375101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:3.0:1789601518.375109:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:2418:x1876532898326912:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601518.375183:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:2418:x1876532898326912:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.375190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:3.0:1789601518.375207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:3.0:1789601518.375213:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898327040:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601518.375238:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898327040:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.375243:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:3.0:1789601518.375255:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:3.0:1789601518.375262:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898327296:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601518.375285:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898327296:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.375290:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:3.0:1789601518.375301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:3.0:1789601518.375306:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898327424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601518.375326:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898327424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 20us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.375331:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:3.0:1789601518.375354:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327168 00000100:00100000:3.0:1789601518.375357:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327168 00000100:00100000:3.0:1789601518.375380:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:3.0:1789601518.375385:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898327168:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601518.375408:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2418:x1876532898327168:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.375412:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00080000:3.0:1789601518.375430:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601518.375434:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601518.375435:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601518.375908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898326784 00000100:00100000:0.0:1789601518.375913:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898326784 00000100:00100000:0.0:1789601518.375953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 342 00000100:00100000:0.0:1789601518.375960:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898326784:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601518.375993:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898326784:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 34us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601518.376007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 342 00000004:00080000:0.0:1789601518.918196:0:9831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387039636605ns, next at 388039633982ns, rc = 0 00000100:00100000:2.0:1789601518.918503:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601518.918525:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918340864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601518.918627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601518.918868:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601518.918879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918340992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601518.918915:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601518.918952:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340864 00000100:00100000:3.0:1789601518.918959:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340864 00000100:00100000:3.0:1789601518.919001:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918340992 00000100:00100000:3.0:1789601518.919004:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918340992 00000100:00100000:3.0:1789601518.919020:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601518.919027:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918340864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601518.919054:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601518.919095:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918340864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.919101:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601518.919118:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789601518.919123:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918340992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601518.919131:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601518.919156:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918340992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601518.919170:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789601518.919184:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601518.919208:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36ab800 x1876532918340992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601518.919224:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918340992:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789601518.919248:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73ced80 x1876532918340864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601518.919259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918340864:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789601518.923848:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789601518.923888:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789601518.923900:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789601518.924035:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924055:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924064:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924071:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601518.924076:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924085:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924103:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x83325275 (ffff8df4c4dbc800) 00010000:00010000:1.0:1789601518.924112:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601518.924117:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924124:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f172b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924145:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924151:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924173:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924178:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601518.924181:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924187:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924195:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df4f5eb2f00) 00010000:00010000:1.0:1789601518.924198:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601518.924201:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924207:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1740 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924225:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924232:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924237:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924241:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601518.924244:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924258:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924266:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x83325275 (ffff8df4c4dbc800) 00010000:00010000:1.0:1789601518.924268:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601518.924271:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924276:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466200/0x74872e3eca9f17a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x83325275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924290:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924296:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924301:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924307:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601518.924309:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924315:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924322:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df4f5eb2800) 00010000:00010000:1.0:1789601518.924325:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601518.924327:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.924340:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f17c5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601518.924435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918341120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789601518.924502:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601518.925684:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918341120 00000100:00100000:2.0:1789601518.925693:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918341120 00000100:00100000:2.0:1789601518.925750:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601518.925767:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918341120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789601518.925806:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789601518.925838:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aab26e9, atime: 0x6aab26e9, ctime: 0x6aab26e9, blocks: 0x0 00010000:00010000:2.0:1789601518.925845:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601518.925860:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1789601518.925864:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601518.925870:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601518.925888:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601518.925898:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601518.925904:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601518.925927:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789601518.926111:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876532918341120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 352us (1608us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789601518.926119:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789601518.926290:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601518.926297:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.926306:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601518.926311:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.926319:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.926337:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.926344:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f2c399/0x74872e3eca9f17d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601518.926363:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601518.926365:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601518.926367:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789601518.926450:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4f74c8000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789601518.926457:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918341120:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789601519.246874:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789601519.629448:0:13735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdc6c40e0 20000000:00000080:1.0:1789601519.629759:0:13735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df3c3446000 uarg=0000000000000000 20000000:01000000:1.0:1789601519.629802:0:13735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789601519.629809:0:13735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789601519.629821:0:13735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789601519.630466:0:13736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789601519.630872:0:13735:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789601519.641915:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789601519.641948:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789601519.641964:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789601519.641979:0:13735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789601519.641999:0:13735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642017:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642026:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642034:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642060:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f167c expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642066:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f168a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642073:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642080:0:13735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642130:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642145:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 23 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642158:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341248:0@lo:104: 00000100:00100000:3.0:1789601519.642221:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601519.642284:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642293:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 23 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642302:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341376:0@lo:104: 00010000:00010000:3.0:1789601519.642329:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642348:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 23 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642357:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341504:0@lo:104: 00010000:00010000:3.0:1789601519.642386:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642394:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642402:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341632:0@lo:104: 00010000:00010000:3.0:1789601519.642425:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642435:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 12 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642443:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341760:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601519.642743:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601519.642751:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.642760:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341888:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601519.642784:0:13735:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601519.642866:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789601519.642887:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.642910:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.642928:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.642937:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918341248 00000100:00100000:0.0:1789601519.642943:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918341248 00000100:00100000:0.0:1789601519.642979:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918341376 00000100:00100000:0.0:1789601519.642982:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918341376 00000100:00100000:0.0:1789601519.642990:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918341504 00000100:00100000:0.0:1789601519.642992:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918341504 00000100:00100000:0.0:1789601519.643001:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918341632 00000100:00100000:0.0:1789601519.643003:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918341632 00000100:00100000:0.0:1789601519.643015:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789601519.643022:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:13735:x1876532918341248:12345-0@lo:104: 00010000:00010000:0.0:1789601519.643033:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643085:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601519.643091:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+6:13735:x1876532918341248:12345-0@lo:104: Request processed in 70us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.643098:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789601519.643168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601519.643174:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:13735:x1876532918341376:12345-0@lo:104: 00010000:00010000:0.0:1789601519.643181:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643216:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789601519.643221:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+5:13735:x1876532918341376:12345-0@lo:104: Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.643227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601519.643240:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789601519.643246:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:13735:x1876532918341504:12345-0@lo:104: 00010000:00010000:0.0:1789601519.643252:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643285:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789601519.643289:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+4:13735:x1876532918341504:12345-0@lo:104: Request processed in 45us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.643294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789601519.643305:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789601519.643311:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13735:x1876532918341632:12345-0@lo:104: 00010000:00010000:0.0:1789601519.643317:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643341:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789601519.643345:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+3:13735:x1876532918341632:12345-0@lo:104: Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.643350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789601519.643375:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789601519.643381:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643388:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601519.643392:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643399:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601519.643405:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601519.643411:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601519.643437:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643444:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601519.643475:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643481:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f1698 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f169f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643495:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789601519.643498:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643504:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601519.643506:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643520:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601519.643525:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.643727:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341248:0@lo:104: 00000100:00100000:3.0:1789601519.643747:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341376:0@lo:104: 00000100:00100000:3.0:1789601519.643755:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341504:0@lo:104: 00000100:00100000:3.0:1789601519.643762:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341632:0@lo:104: 10000000:01000000:0.0:1789601519.643829:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601519.643846:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643853:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601519.643859:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643865:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3467e00/0x74872e3eca9f168a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1691 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643875:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601519.643878:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643882:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601519.643885:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643892:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601519.643897:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601519.643908:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601519.643924:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643929:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601519.643951:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643958:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7363a00/0x74872e3eca9f167c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643968:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601519.643971:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643976:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601519.643979:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.643985:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601519.643991:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601519.643996:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601519.644008:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644013:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601519.644026:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644033:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3467200/0x74872e3eca9f166e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f1675 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644046:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601519.644048:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601519.644050:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601519.644056:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601519.644061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601519.644077:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918342016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601519.644111:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.644141:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601519.644147:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918342144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601519.644168:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.644193:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918342400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601519.644214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.644231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601519.644235:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918342272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601519.644254:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601519.644278:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342016 00000100:00100000:0.0:1789601519.644283:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342016 00010000:00010000:0.0:1789601519.644306:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 24 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601519.644322:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342144 00000100:00100000:0.0:1789601519.644324:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342144 00010000:00010000:0.0:1789601519.644334:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 25 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601519.644352:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342400 00000100:00100000:0.0:1789601519.644355:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342400 00010000:00010000:0.0:1789601519.644365:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 26 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601519.644373:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342272 00000100:00100000:0.0:1789601519.644375:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342272 00010000:00010000:0.0:1789601519.644382:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 27 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601519.644392:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601519.644398:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+27:3647:x1876532918342016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601519.644408:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601519.644412:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 27 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644423:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 27 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644436:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362800/0x74872e3eca9f169f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f1698 expref: 27 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.644447:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.645479:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+26:3647:x1876532918342016:12345-0@lo:103:ldlm_bl.0 Request processed in 1075us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.645490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601519.645513:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601519.645521:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+25:3647:x1876532918342144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601519.645577:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601519.645586:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 25 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645609:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 25 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645624:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f1691 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f168a expref: 25 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645635:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.645660:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918342144:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.645666:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601519.645678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601519.645685:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3646:x1876532918342400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601519.645695:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601519.645699:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645708:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645718:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382600/0x74872e3eca9f1675 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f166e expref: 23 pid: 6515 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645727:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.645756:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3646:x1876532918342400:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.645770:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601519.645782:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789601519.645788:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3646:x1876532918342272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601519.645796:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601519.645801:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 21 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645810:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 21 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645819:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383a00/0x74872e3eca9f1683 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f167c expref: 21 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.645827:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.645849:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3646:x1876532918342272:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.645855:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789601519.645950:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918342272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601519.645960:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918342400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601519.648081:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918342016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601519.648168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918342144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601519.651248:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341760:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601519.651266:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876532918341888:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601519.651309:0:13735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601519.651443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601519.651526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601519.651606:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327680 00000100:00100000:2.0:1789601519.651615:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327680 00010000:00010000:2.0:1789601519.651655:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 13 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601519.651705:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327552 00000100:00100000:2.0:1789601519.651709:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327552 00010000:00010000:2.0:1789601519.651723:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 14 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601519.651749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:2.0:1789601519.651758:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+14:2416:x1876532898327680:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601519.651773:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601519.651778:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 14 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601519.651800:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 14 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601519.651817:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f1660 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a56 expref: 14 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601519.651833:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.651858:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1789601519.651869:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898327552:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601519.651879:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789601519.651888:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898327680:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 129us (444us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601519.651896:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 13 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601519.651897:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00010000:00010000:0.0:1789601519.651913:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 13 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651937:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73eee00/0x74872e3eca9f1667 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a5d expref: 12 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651951:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651959:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651975:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651982:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651990:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.651997:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.652003:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601519.652007:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.652015:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.652029:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601519.652047:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601519.652068:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:2416:x1876532898327552:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 202us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.652075:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00010000:00010000:2.0:1789601519.652359:0:13735:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601519.652369:0:13735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601519.652376:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362600/0x74872e3eca9f17da lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601519.941906:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601519.941931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918342528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601519.942017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601519.942256:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342528 00000100:00100000:2.0:1789601519.942267:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342528 00000100:00100000:2.0:1789601519.942318:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789601519.942328:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918342528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601519.942362:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601519.942414:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918342528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601519.942420:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789601519.942464:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918342528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601520.261867:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789601520.429455:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5e76ccf0 20000000:00000080:2.0:1789601520.429473:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df4f7367000 uarg=0000000000000000 20000000:01000000:2.0:1789601520.429518:0:13784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789601520.429524:0:13784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789601520.429529:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789601520.431065:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1789601520.431313:0:13784:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1789601520.431390:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1789601520.431420:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1789601520.431437:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1789601520.431448:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789601520.431467:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431482:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431491:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431514:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431521:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431528:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431534:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601520.431538:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431745:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431831:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431839:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601520.431845:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383e00/0x74872e3eca9f17e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601520.455269:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601520.455293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918342656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601520.455357:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601520.455749:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342656 00000100:00100000:2.0:1789601520.455757:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342656 00000100:00100000:2.0:1789601520.455813:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601520.455822:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918342656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601520.455853:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601520.455912:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918342656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601520.455919:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601520.455965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918342656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601520.996682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601520.996846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327808 00000100:00100000:3.0:1789601520.996857:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327808 00000100:00100000:3.0:1789601520.996912:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 343 00000100:00100000:3.0:1789601520.996922:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:6189:x1876532898327808:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601520.996937:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601520.996955:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7362e00/0x74872e3eca9f17e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48aaa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601520.996994:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7362e00/0x74872e3eca9f17e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aaa expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601520.997006:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7362e00/0x74872e3eca9f17e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aaa expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601520.997030:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362e00, rc 0) 00000100:00100000:3.0:1789601520.997768:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898327808:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 172us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601520.997782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 343 00000100:00100000:2.0:1789601521.006859:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601521.006968:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898327936 00000100:00100000:1.0:1789601521.006980:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898327936 00000100:00100000:1.0:1789601521.007040:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 344 00000100:00100000:1.0:1789601521.007050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898327936:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.007501:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898327936:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 451us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.007510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 344 00000100:00100000:1.0:1789601521.020384:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601521.020516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328064 00000100:00100000:3.0:1789601521.020527:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328064 00000100:00100000:3.0:1789601521.020617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 345 00000100:00100000:3.0:1789601521.020627:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898328064:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.020794:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898328064:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 168us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.020802:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 345 00000100:00100000:0.0:1789601521.027992:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601521.028336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328192 00000100:00100000:3.0:1789601521.028348:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328192 00000100:00100000:3.0:1789601521.028413:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 346 00000100:00100000:3.0:1789601521.028423:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:10820:x1876532898328192:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789601521.028595:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:10820:x1876532898328192:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 172us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.028603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 346 00000100:00100000:2.0:1789601521.037104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601521.037376:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328320 00000100:00100000:1.0:1789601521.037387:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328320 00000100:00100000:1.0:1789601521.037452:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 347 00000100:00100000:1.0:1789601521.037462:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:10820:x1876532898328320:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601521.037947:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:10820:x1876532898328320:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 484us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.037954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 347 00000100:00100000:1.0:1789601521.063913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601521.064140:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328448 00000100:00100000:2.0:1789601521.064150:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328448 00000100:00100000:2.0:1789601521.064202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 348 00000100:00100000:2.0:1789601521.064214:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:6189:x1876532898328448:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601521.064231:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601521.064249:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383600/0x74872e3eca9f17ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ab1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601521.064278:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383600/0x74872e3eca9f17ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab1 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601521.064289:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383600/0x74872e3eca9f17ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab1 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601521.064298:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383600, rc 0) 00000100:00100000:2.0:1789601521.064359:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898328448:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 147us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601521.064367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 348 00000100:00100000:0.0:1789601521.076042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601521.076236:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328576 00000100:00100000:1.0:1789601521.076246:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328576 00000100:00100000:1.0:1789601521.076304:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 349 00000100:00100000:1.0:1789601521.076314:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898328576:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.076634:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898328576:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 318us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.076651:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 349 00000100:00100000:0.0:1789601521.095391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601521.095533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328704 00000100:00100000:3.0:1789601521.095544:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328704 00000100:00100000:3.0:1789601521.095653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 350 00000100:00100000:3.0:1789601521.095663:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898328704:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.095800:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:6189:x1876532898328704:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 138us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.095817:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 350 00000100:00100000:0.0:1789601521.103892:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601521.104115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328832 00000100:00100000:2.0:1789601521.104126:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328832 00000100:00100000:2.0:1789601521.104179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 351 00000100:00100000:2.0:1789601521.104190:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:10824:x1876532898328832:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601521.104347:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:10824:x1876532898328832:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 158us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601521.104354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 351 00000100:00100000:0.0:1789601521.111088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601521.111242:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898328960 00000100:00100000:1.0:1789601521.111252:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898328960 00000100:00100000:1.0:1789601521.111311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 352 00000100:00100000:1.0:1789601521.111322:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:10824:x1876532898328960:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601521.111470:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:10824:x1876532898328960:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 149us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.111478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 352 00010000:00010000:0.0:1789601521.287601:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789601521.542279:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601521.542288:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df501e60000 from 7 10000000:01000000:0.0:1789601521.542293:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601521.542345:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601521.542356:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601521.542369:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601521.542396:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918342784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601521.542487:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.542598:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601521.542752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342784 00000100:00100000:3.0:1789601521.542762:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342784 00000100:00100000:3.0:1789601521.542809:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789601521.542818:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:6519:x1876532918342784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601521.542833:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601521.542848:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f17fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f17f6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.542870:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f17fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f17f6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.542880:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f17fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f17f6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.542888:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363800, rc 0) 00000100:00100000:3.0:1789601521.542938:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918342784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.542945:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789601521.543729:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918342784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601521.543747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601521.543757:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601521.543824:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601521.543863:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.543900:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601521.543969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918342912 00000100:00100000:2.0:1789601521.543974:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918342912 00000100:00100000:2.0:1789601521.544016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789601521.544025:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918342912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601521.544143:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918342912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601521.544151:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789601521.544273:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601521.544301:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601521.544345:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.544366:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.544425:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343040 00000100:00100000:1.0:1789601521.544430:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343040 00000100:00100000:1.0:1789601521.544460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789601521.544467:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918343040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.544549:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918343040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.544602:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789601521.544825:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601521.545209:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13798:1876532918343168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601521.545246:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.545277:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601521.545329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343168 00000100:00100000:3.0:1789601521.545334:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343168 00000100:00100000:3.0:1789601521.545368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789601521.545375:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:13798:x1876532918343168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601521.545472:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:13798:x1876532918343168:12345-0@lo:502:llog_process_th.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.545479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789601521.545630:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13798:1876532918343168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601521.545651:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601521.545660:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.545662:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601521.545670:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df501e60000 00000020:00000080:0.0:1789601521.545679:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601521.545742:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601521.545746:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.545748:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601521.545750:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601521.545753:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.545754:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789601521.545757:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df501e60000 00000020:00000080:0.0:1789601521.545760:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789601521.545793:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13798:1876532918343296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601521.545823:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.545850:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601521.549882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343296 00000100:00100000:3.0:1789601521.549901:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343296 00000100:00100000:3.0:1789601521.549959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789601521.549969:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:13798:x1876532918343296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601521.550122:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:13798:x1876532918343296:12345-0@lo:502:llog_process_th.0 Request processed in 153us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.550130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789601521.550689:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13798:1876532918343296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601521.550727:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601521.550736:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.550738:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789601521.550744:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789601521.551026:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789601521.551049:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601521.551059:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.551070:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601521.551079:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601521.551082:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f70a3000 from 7 10000000:01000000:3.0:1789601521.551085:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601521.551115:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.551122:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.551131:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601521.551151:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.551193:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.551235:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.552340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343424 00000100:00100000:1.0:1789601521.552350:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343424 00000100:00100000:1.0:1789601521.552418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789601521.552428:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:6519:x1876532918343424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601521.552440:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601521.552456:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f180b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1804 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.552479:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f180b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1804 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.552504:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f180b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1804 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.552514:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee200, rc 0) 00000100:00100000:1.0:1789601521.552623:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918343424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.552631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789601521.552680:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601521.552697:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.552705:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601521.552766:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.552795:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.552818:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9b549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.552830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343552 00000100:00100000:1.0:1789601521.552833:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343552 00000100:00100000:1.0:1789601521.552849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789601521.552855:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918343552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.552951:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918343552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.552958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789601521.552986:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.553018:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.553054:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.553068:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9b549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.553078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343680 00000100:00100000:1.0:1789601521.553081:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343680 00000100:00100000:1.0:1789601521.553098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789601521.553103:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918343680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.553171:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918343680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.553177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789601521.553213:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918343680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.553391:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13800:1876532918343808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.553425:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.553442:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343808 00000100:00100000:1.0:1789601521.553446:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343808 00000100:00100000:1.0:1789601521.553462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789601521.553468:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:13800:x1876532918343808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.553535:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:13800:x1876532918343808:12345-0@lo:502:llog_process_th.0 Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.553541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789601521.553603:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.553615:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13800:1876532918343808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601521.553636:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601521.553645:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601521.553651:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789601521.553659:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4f70a3000 00000020:00000080:1.0:1789601521.553661:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601521.553720:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601521.554030:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601521.554033:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789601521.554038:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601521.554041:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601521.554042:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789601521.554046:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4f70a3000 00000020:00000080:1.0:1789601521.554049:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601521.554251:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13800:1876532918343936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.554291:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.554313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918343936 00000100:00100000:1.0:1789601521.554318:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918343936 00000100:00100000:1.0:1789601521.554340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789601521.554346:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:13800:x1876532918343936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.554417:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:13800:x1876532918343936:12345-0@lo:502:llog_process_th.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.554423:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789601521.554452:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.554468:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13800:1876532918343936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601521.554487:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601521.554491:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601521.554492:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789601521.554495:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789601521.554546:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789601521.554596:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601521.554604:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554621:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601521.554630:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601521.554632:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4f8b56000 from 7 10000000:01000000:1.0:1789601521.554635:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601521.554655:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554663:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554672:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601521.554684:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.554708:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.554722:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.554733:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344064 00000100:00100000:1.0:1789601521.554736:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344064 00000100:00100000:1.0:1789601521.554752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789601521.554757:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:6519:x1876532918344064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601521.554765:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601521.554775:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73efa00/0x74872e3eca9f1819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1812 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554795:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73efa00/0x74872e3eca9f1819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1812 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554814:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73efa00/0x74872e3eca9f1819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1812 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554822:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efa00, rc 0) 00000100:00100000:1.0:1789601521.554849:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.554855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789601521.554880:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601521.554891:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.554900:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601521.554939:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.554962:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.554975:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.554986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344192 00000100:00100000:1.0:1789601521.554989:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344192 00000100:00100000:1.0:1789601521.555006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789601521.555011:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.555087:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.555093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789601521.555118:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.555151:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.555182:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.555194:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.555204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344320 00000100:00100000:1.0:1789601521.555208:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344320 00000100:00100000:1.0:1789601521.555223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789601521.555228:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.555287:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.555294:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789601521.555328:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.563879:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13801:1876532918344448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.563974:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.564068:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601521.565152:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344448 00000100:00100000:0.0:1789601521.565163:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344448 00000100:00100000:1.0:1789601521.566592:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789601521.566607:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:13801:x1876532918344448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.568133:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:13801:x1876532918344448:12345-0@lo:502:llog_process_th.0 Request processed in 1524us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.568144:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789601521.568252:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13801:1876532918344448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601521.568289:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601521.568298:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.568300:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601521.568308:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4f8b56000 00000020:00000080:0.0:1789601521.568310:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601521.568378:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601521.568382:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.568384:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601521.568386:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601521.568390:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601521.568397:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789601521.568401:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4f8b56000 00000020:00000080:0.0:1789601521.568403:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789601521.568456:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13801:1876532918344576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601521.568506:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.576489:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601521.578640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344576 00000100:00100000:3.0:1789601521.578671:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344576 00000100:00100000:3.0:1789601521.578732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789601521.578743:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:13801:x1876532918344576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601521.578920:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:13801:x1876532918344576:12345-0@lo:502:llog_process_th.0 Request processed in 179us (10414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.578929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789601521.579003:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8ab3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13801:1876532918344576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601521.579039:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601521.579047:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601521.579049:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789601521.579053:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789601521.581181:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789601521.581215:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601521.581226:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581239:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601521.581268:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601521.581270:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4d017d800 from 7 10000000:01000000:1.0:1789601521.581273:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601521.581309:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581317:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581328:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601521.581351:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.581408:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601521.581448:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c55aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.581482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344704 00000100:00100000:1.0:1789601521.581490:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344704 00000100:00100000:1.0:1789601521.581523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789601521.581530:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:6519:x1876532918344704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601521.581542:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601521.581552:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f1820 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581601:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f1820 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581855:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f1820 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601521.581879:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef200, rc 0) 00000100:00100000:1.0:1789601521.581926:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918344704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 396us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.581933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789601521.582095:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8945880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601521.582109:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.582117:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601521.582176:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.582204:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.582228:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.582327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344832 00000100:00100000:1.0:1789601521.582331:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344832 00000100:00100000:1.0:1789601521.582364:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789601521.582372:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918344832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601521.582471:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918344832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.582478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789601521.582544:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.582680:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.582724:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.582836:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601521.582851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918344960 00000100:00100000:3.0:1789601521.582861:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918344960 00000100:00100000:3.0:1789601521.582881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789601521.582888:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918344960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601521.582964:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:6519:x1876532918344960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.582970:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789601521.583003:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ae79c1b-f0a7-456b-b85e-4e644036ec22:6519:1876532918344960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789601521.586825:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789601521.588005:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13804:1876532918345088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601521.588088:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.588153:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.588476:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345088 00000100:00100000:1.0:1789601521.588484:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345088 00000100:00100000:1.0:1789601521.588537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789601521.588547:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:13804:x1876532918345088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.588709:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:13804:x1876532918345088:12345-0@lo:502:llog_process_th.0 Request processed in 164us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.588717:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789601521.588972:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13804:1876532918345088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601521.589006:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601521.589017:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601521.589020:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789601521.589027:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4d017d800 00000020:00000080:2.0:1789601521.589030:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789601521.589089:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601521.589092:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601521.589094:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789601521.589096:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601521.589098:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601521.589100:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789601521.589103:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4d017d800 00000020:00000080:2.0:1789601521.589111:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789601521.589151:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13804:1876532918345216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601521.589190:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.589219:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601521.589999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345216 00000100:00100000:1.0:1789601521.590009:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345216 00000100:00100000:1.0:1789601521.590050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789601521.590060:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:13804:x1876532918345216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601521.590161:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:13804:x1876532918345216:12345-0@lo:502:llog_process_th.0 Request processed in 103us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601521.590169:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789601521.590491:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ae79c1b-f0a7-456b-b85e-4e644036ec22:13804:1876532918345216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601521.590521:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601521.590527:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601521.590529:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789601521.590533:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789601521.590719:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789601521.590739:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601521.590749:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601521.590760:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601521.611142:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601521.989959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918345728:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.989971:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918345344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601521.990076:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918345600:0@lo:400:kworker.0 00000100:00100000:1.0:1789601521.990146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918345472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.993734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.993813:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918346240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.993865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.993881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918346752:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.993897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601521.993956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345728 00000100:00100000:3.0:1789601521.993964:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345728 00000100:00100000:3.0:1789601521.994005:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789601521.994012:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918345728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.994077:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918345728:12345-0@lo:400:kworker.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.994084:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789601521.994118:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346240 00000100:00100000:3.0:1789601521.994121:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346240 00000100:00100000:3.0:1789601521.994151:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346752 00000100:00100000:3.0:1789601521.994152:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346752 00000100:00100000:3.0:1789601521.994168:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789601521.994173:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918346240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.994199:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918346240:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.994205:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789601521.994213:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789601521.994218:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918346752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.994238:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918346752:12345-0@lo:400:kworker.0 Request processed in 21us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.994243:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789601521.994260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601521.994264:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601521.994292:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918345728:0@lo:400:kworker.0 00010000:00080000:3.0:1789601521.994304:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36ab100 x1876532918346240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601521.994315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918346240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.994323:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918346752:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.997467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.997543:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918345856:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.997629:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.997655:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918346368:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.997684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.997715:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918346880:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.997735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601521.997786:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345856 00000100:00100000:0.0:1789601521.997794:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345856 00000100:00100000:0.0:1789601521.997839:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789601521.997848:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918345856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.997902:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918345856:12345-0@lo:400:kworker.0 Request processed in 55us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601521.997908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789601521.997932:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346368 00000100:00100000:0.0:1789601521.997937:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346368 00000100:00100000:0.0:1789601521.997965:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346880 00000100:00100000:0.0:1789601521.997968:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346880 00000100:00100000:0.0:1789601521.997997:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789601521.998003:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918346368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.998662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345344 00000100:00100000:3.0:1789601521.998677:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345344 00000100:00100000:3.0:1789601521.998728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789601521.998735:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.998778:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918345344:12345-0@lo:400:kworker.0 Request processed in 44us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.998785:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789601521.998819:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789601521.998827:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918346880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.998858:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918346880:12345-0@lo:400:kworker.0 Request processed in 33us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601521.998864:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789601521.998884:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601521.998889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601521.998946:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918345344:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.998960:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918345856:0@lo:400:kworker.0 00000100:00100000:3.0:1789601521.998971:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918346880:0@lo:400:kworker.0 00000100:00100000:0.0:1789601521.999453:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918346368:12345-0@lo:400:kworker.0 Request processed in 1449us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601521.999462:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789601521.999597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.999626:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918346112:0@lo:400:kworker.0 00000100:00100000:2.0:1789601521.999655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.999676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918346624:0@lo:400:kworker.0 00000100:00100000:2.0:1789601521.999767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601521.999807:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346112 00000100:00100000:2.0:1789601521.999812:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346112 00000100:00100000:2.0:1789601521.999846:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346624 00000100:00100000:2.0:1789601521.999849:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346624 00000100:00100000:2.0:1789601521.999870:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789601521.999877:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918346112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601521.999914:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918346112:12345-0@lo:400:kworker.0 Request processed in 39us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601521.999920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789601521.999935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789601521.999941:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601522.000143:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345600 00000100:00100000:0.0:1789601522.000147:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345600 00000100:00100000:0.0:1789601522.000173:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789601522.000179:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918345600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601522.000214:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918345600:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601522.000220:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789601522.000253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789601522.000339:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36a8a80 x1876532918346368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601522.000352:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918346368:0@lo:400:kworker.0 00000100:00100000:3.0:1789601522.000381:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918345600:0@lo:400:kworker.0 00010000:00080000:3.0:1789601522.000391:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36abb80 x1876532918346112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601522.000398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918346112:0@lo:400:kworker.0 00010000:00080000:3.0:1789601522.000418:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36aa680 x1876532918346624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601522.000426:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918346624:0@lo:400:kworker.0 00000100:00100000:2.0:1789601522.000472:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918346624:12345-0@lo:400:kworker.0 Request processed in 530us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601522.000478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789601522.003164:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601522.003224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918345984:0@lo:400:kworker.0 00000100:00100000:1.0:1789601522.003253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601522.003284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918346496:0@lo:400:kworker.0 00000100:00100000:1.0:1789601522.003307:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601522.004892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345472 00000100:00100000:3.0:1789601522.004904:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345472 00000100:00100000:3.0:1789601522.004973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918345984 00000100:00100000:3.0:1789601522.004977:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918345984 00000100:00100000:3.0:1789601522.005013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918346496 00000100:00100000:3.0:1789601522.005017:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918346496 00000100:00100000:3.0:1789601522.005050:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789601522.005063:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918345472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601522.005138:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918345472:12345-0@lo:400:kworker.0 Request processed in 76us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601522.010793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789601522.010814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789601522.010823:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918345984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601522.010864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789601522.010875:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918346496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601522.011277:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918345984:12345-0@lo:400:kworker.0 Request processed in 470us (8020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601522.011285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789601522.011294:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918346496:12345-0@lo:400:kworker.0 Request processed in 421us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601522.011304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1789601522.011320:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601522.011458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918345472:0@lo:400:kworker.0 00000100:00100000:0.0:1789601522.011473:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918345984:0@lo:400:kworker.0 00000100:00100000:0.0:1789601522.011483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918346496:0@lo:400:kworker.0 00010000:00010000:2.0:1789601522.310063:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601522.503811:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601522.503834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918347136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601522.503902:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601522.503986:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347136 00000100:00100000:1.0:1789601522.503994:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347136 00000100:00100000:1.0:1789601522.504044:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789601522.504054:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918347136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601522.504083:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601522.504129:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918347136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601522.504136:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1789601522.504178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4cd0b9c00 x1876532918347136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601522.504196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918347136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601522.504358:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601522.504369:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918347008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601522.504421:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601522.505394:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347008 00000100:00100000:1.0:1789601522.505403:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347008 00000100:00100000:1.0:1789601522.505456:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601522.505466:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918347008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601522.505486:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601522.505616:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918347008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601522.505622:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789601522.505779:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f8946680 x1876532918347008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601522.505796:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918347008:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789601522.630294:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789601522.631305:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601523.333727:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601523.492139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601523.492185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601523.492211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601523.492246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601523.492287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601523.492315:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601523.492356:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329472 00000100:00100000:3.0:1789601523.492376:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329472 00000100:00100000:0.0:1789601523.492377:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329216 00000100:00100000:0.0:1789601523.492389:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329216 00000100:00100000:1.0:1789601523.492466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329088 00000100:00100000:1.0:1789601523.492472:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329088 00000100:00100000:3.0:1789601523.492488:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:3.0:1789601523.492505:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329472:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601523.492530:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 374 00000100:00100000:1.0:1789601523.492543:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898329088:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601523.492707:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329728 00000100:00100000:2.0:1789601523.492712:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329728 00000100:00100000:1.0:1789601523.492758:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898329088:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 218us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601523.492767:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 374 00000100:00100000:1.0:1789601523.492804:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329344 00000100:00100000:1.0:1789601523.492807:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329344 00000100:00100000:3.0:1789601523.498436:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329472:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 5895us (6209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601523.498456:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:0.0:1789601523.499514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329600 00000100:00100000:0.0:1789601523.499527:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329600 00000100:00100000:0.0:1789601523.499589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:0.0:1789601523.499600:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329216:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601523.499681:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329216:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 82us (7551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601523.499689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:0.0:1789601523.499760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:0.0:1789601523.499768:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898329600:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601523.499822:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898329600:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 55us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601523.499829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:2.0:1789601523.500848:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:2.0:1789601523.500861:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898329728:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601523.500932:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898329728:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (8720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601523.500939:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:1.0:1789601523.506370:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:1.0:1789601523.506854:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329344:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601523.506937:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898329344:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 92us (14650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601523.506946:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00080000:3.0:1789601523.511272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601523.511288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601523.511296:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601524.037939:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918347392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601524.037947:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601524.037971:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918347264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601524.038048:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601524.038108:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347264 00000100:00100000:3.0:1789601524.038120:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347264 00000100:00100000:3.0:1789601524.038203:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789601524.038216:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918347264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601524.038255:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601524.038329:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918347264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601524.038339:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789601524.038370:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601524.038386:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601524.038426:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347392 00000100:00100000:3.0:1789601524.038431:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347392 00000100:00100000:3.0:1789601524.038462:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789601524.038471:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918347392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601524.038488:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601524.038527:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918347392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601524.038674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f8946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918347264:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789601524.038868:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601524.038904:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918347392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601524.041167:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:0.0:1789601524.357879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601525.063721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918347520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601525.063794:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601525.063934:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347520 00000100:00100000:2.0:1789601525.063952:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347520 00000100:00100000:2.0:1789601525.064001:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789601525.064011:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918347520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601525.064041:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601525.064109:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918347520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601525.064117:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789601525.064217:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918347520:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789601525.066014:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1789601525.381923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601525.575574:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601525.575611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918347648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601525.575712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601525.576140:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347648 00000100:00100000:2.0:1789601525.576152:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347648 00000100:00100000:2.0:1789601525.576225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601525.576239:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918347648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601525.576306:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601525.576405:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918347648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601525.576413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789601525.576684:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918347648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601526.405989:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601527.112006:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918347776:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.112006:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918348160:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.112120:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918347904:0@lo:400:kworker.0 00000100:00100000:0.0:1789601527.116344:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918348032:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.116672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.116776:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918348672:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.116888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601527.116936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.116938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918349184:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.119267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.119356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789601527.119372:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918348800:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.119420:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.119574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918349312:0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.119601:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.119643:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348672 00000100:00100000:1.0:1789601527.119654:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348672 00000100:00100000:3.0:1789601527.119923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601527.119955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347776 00000100:00100000:3.0:1789601527.119959:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347776 00000100:00100000:3.0:1789601527.120013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789601527.120023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918347776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918347776:12345-0@lo:400:kworker.0 Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.120103:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789601527.120168:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918347776:0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120177:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918348288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601527.120233:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348288 00000100:00100000:3.0:1789601527.120238:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348288 00000100:00100000:3.0:1789601527.120479:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601527.120487:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918348288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120528:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918348288:12345-0@lo:400:kworker.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.120547:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789601527.120591:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349184 00000100:00100000:1.0:1789601527.120596:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349184 00000100:00100000:1.0:1789601527.120613:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348800 00000100:00100000:1.0:1789601527.120615:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348800 00000100:00100000:1.0:1789601527.120630:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349312 00000100:00100000:1.0:1789601527.120633:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349312 00000100:00100000:1.0:1789601527.120649:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601527.120656:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.120704:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918348672:12345-0@lo:400:kworker.0 Request processed in 45us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.120711:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601527.120729:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601527.120736:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918349184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.120767:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918349184:12345-0@lo:400:kworker.0 Request processed in 32us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.120775:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601527.120790:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601527.120798:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120814:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918348288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120868:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348160 00000100:00100000:3.0:1789601527.120873:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348160 00000100:00100000:3.0:1789601527.120902:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918347904 00000100:00100000:3.0:1789601527.120905:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918347904 00000100:00100000:3.0:1789601527.120926:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789601527.120932:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918348160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.120971:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918348160:12345-0@lo:400:kworker.0 Request processed in 39us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.120977:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789601527.120990:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789601527.120997:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918347904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.121028:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918347904:12345-0@lo:400:kworker.0 Request processed in 32us (4099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.121034:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1789601527.121809:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601527.121817:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601527.121875:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789601527.121889:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918349312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.121941:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918349312:12345-0@lo:400:kworker.0 Request processed in 58us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.121947:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601527.122020:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918348800:12345-0@lo:400:kworker.0 Request processed in 1221us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.122029:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789601527.122252:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789601527.122264:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4f74c8000, transno 4294967301 00000100:00100000:3.0:1789601527.122298:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918349312:0@lo:400:kworker.0 00010000:00080000:3.0:1789601527.122320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb480 x1876532918348672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601527.122346:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918348672:0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.122361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918349184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.122372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918348160:0@lo:400:kworker.0 00010000:00080000:3.0:1789601527.122402:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31b8700 x1876532918348800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601527.122411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918348800:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.127175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918347904:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.127190:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918348416:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.127246:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601527.127286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918348928:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.127306:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.127377:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348416 00000100:00100000:1.0:1789601527.127386:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348416 00000100:00100000:1.0:1789601527.127453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348928 00000100:00100000:1.0:1789601527.127457:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348928 00000100:00100000:1.0:1789601527.127479:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789601527.127487:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918348416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.127551:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918348416:12345-0@lo:400:kworker.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.127576:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789601527.127591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789601527.127597:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918348928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.127625:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918348928:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.127631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:2.0:1789601527.127708:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601527.127731:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918348416:0@lo:400:kworker.0 00000100:00100000:2.0:1789601527.127742:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918348928:0@lo:400:kworker.0 00000100:00100000:0.0:1789601527.130996:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601527.131048:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918348544:0@lo:400:kworker.0 00000100:00100000:0.0:1789601527.131083:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601527.131110:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918349056:0@lo:400:kworker.0 00000100:00100000:0.0:1789601527.131131:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.131345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348544 00000100:00100000:1.0:1789601527.131354:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348544 00000100:00100000:1.0:1789601527.131419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349056 00000100:00100000:1.0:1789601527.131423:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349056 00000100:00100000:1.0:1789601527.131448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789601527.131467:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918348544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.131520:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918348544:12345-0@lo:400:kworker.0 Request processed in 64us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.131527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789601527.131578:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789601527.131586:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601527.131614:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918349056:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.131639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:0.0:1789601527.131750:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318ed80 x1876532918348544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601527.131764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918348544:0@lo:400:kworker.0 00010000:00080000:0.0:1789601527.131775:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bbb80 x1876532918349056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601527.131784:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918349056:0@lo:400:kworker.0 00000100:00080000:2.0:1789601527.131959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601527.132014:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918348032 00000100:00100000:3.0:1789601527.132019:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918348032 00000100:00100000:3.0:1789601527.132059:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601527.132066:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601527.132119:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918348032:12345-0@lo:400:kworker.0 Request processed in 54us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601527.132126:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789601527.132260:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918348032:0@lo:400:kworker.0 00010000:00010000:0.0:1789601527.430961:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601527.622435:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601527.622468:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918349440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601527.622550:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.622815:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349440 00000100:00100000:1.0:1789601527.622823:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349440 00000100:00100000:1.0:1789601527.622878:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789601527.622887:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918349440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601527.622928:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601527.622972:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918349440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.622979:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1789601527.623074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc4ea00 x1876532918349440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601527.623090:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918349440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601527.623237:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918349568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601527.623266:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601527.623338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349568 00000100:00100000:1.0:1789601527.623343:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349568 00000100:00100000:1.0:1789601527.623375:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601527.623382:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918349568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601527.623393:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601527.623436:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918349568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601527.623442:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1789601527.623671:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36aa680 x1876532918349568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601527.623685:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918349568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789601528.453798:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601528.612289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601528.612544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330112 00000100:00100000:0.0:1789601528.612553:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330112 00000100:00100000:0.0:1789601528.612641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330368 00000100:00100000:0.0:1789601528.612644:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330368 00000100:00100000:0.0:1789601528.612657:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329984 00000100:00100000:0.0:1789601528.612659:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329984 00000100:00100000:0.0:1789601528.612671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330496 00000100:00100000:0.0:1789601528.612672:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330496 00000100:00100000:0.0:1789601528.612688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 259 00000100:00100000:0.0:1789601528.612697:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601528.612765:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601528.612773:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 259 00000100:00100000:0.0:1789601528.612790:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 260 00000100:00100000:0.0:1789601528.612797:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898330368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601528.612821:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898330368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601528.612841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 260 00000100:00100000:0.0:1789601528.612854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 261 00000100:00100000:0.0:1789601528.612860:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898329984:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601528.612884:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898329984:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601528.612889:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 261 00000100:00100000:0.0:1789601528.612900:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 262 00000100:00100000:0.0:1789601528.612914:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898330496:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601528.612936:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898330496:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601528.612942:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 262 00000100:00080000:2.0:1789601528.613232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601528.613237:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601528.614120:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330240 00000100:00100000:3.0:1789601528.614130:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330240 00000100:00100000:3.0:1789601528.614200:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:3.0:1789601528.614209:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330240:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601528.614271:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330240:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 63us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.614291:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:3.0:1789601528.614318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898329856 00000100:00100000:3.0:1789601528.614324:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898329856 00000100:00100000:3.0:1789601528.614350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 376 00000100:00100000:3.0:1789601528.614357:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898329856:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:2.0:1789601528.614761:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601528.614908:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5020d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898329856:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 550us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.614916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 376 00000100:00100000:3.0:1789601529.157894:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601529.157979:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601529.158162:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349696 00000100:00100000:0.0:1789601529.158171:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349696 00000100:00100000:0.0:1789601529.158233:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789601529.158243:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918349696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601529.158269:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601529.158310:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918349696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601529.158316:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789601529.158405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c23fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918349696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789601529.158472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601529.158831:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601529.158842:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918349824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601529.158875:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601529.159005:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349824 00000100:00100000:2.0:1789601529.159010:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349824 00000100:00100000:2.0:1789601529.159062:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601529.159070:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918349824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601529.159083:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601529.159140:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918349824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601529.159146:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601529.159181:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918349824:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789601529.159275:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601529.478154:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601530.185796:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601530.185828:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918349952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601530.185921:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601530.186294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918349952 00000100:00100000:2.0:1789601530.186305:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918349952 00000100:00100000:2.0:1789601530.186375:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789601530.186386:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918349952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601530.186429:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601530.186498:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918349952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601530.186506:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789601530.186652:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918349952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601530.503418:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601530.695488:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601530.695537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918350080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601530.695664:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601530.696047:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350080 00000100:00100000:3.0:1789601530.696059:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350080 00000100:00100000:3.0:1789601530.696121:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601530.696132:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918350080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601530.696180:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789601530.696361:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918350080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 230us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601530.696372:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601530.697137:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918350080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601531.526661:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601532.229968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918350464:0@lo:400:kworker.0 00000100:00100000:0.0:1789601532.230081:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.230248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918350208:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.230356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601532.230363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230392:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.230431:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350336 00000100:00100000:2.0:1789601532.230441:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350336 00000100:00100000:2.0:1789601532.230509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789601532.230520:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918350336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230625:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918350336:12345-0@lo:400:kworker.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601532.230648:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789601532.230686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918350592:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230715:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.230746:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350592 00000100:00100000:2.0:1789601532.230750:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350592 00000100:00100000:2.0:1789601532.230777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789601532.230784:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918350592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230819:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918350592:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601532.230826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789601532.230872:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918350592:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.230930:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350464 00000100:00100000:2.0:1789601532.230934:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350464 00000100:00100000:2.0:1789601532.230961:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601532.230968:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.232306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350208 00000100:00100000:3.0:1789601532.232322:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350208 00000100:00100000:3.0:1789601532.232377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789601532.232387:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.232471:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918350208:12345-0@lo:400:kworker.0 Request processed in 85us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601532.232479:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789601532.232588:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918350208:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918350848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234338:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.234374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918351360:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234396:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.234419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789601532.234426:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918350720:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.234483:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918351232:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234529:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.234547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918351744:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234642:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.234681:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350720 00000100:00100000:1.0:1789601532.234688:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350720 00000100:00100000:3.0:1789601532.234749:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351232 00000100:00100000:3.0:1789601532.234754:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351232 00000100:00100000:3.0:1789601532.234809:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351744 00000100:00100000:1.0:1789601532.234848:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789601532.234858:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918350720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234914:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918350720:12345-0@lo:400:kworker.0 Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.234921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789601532.234948:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601532.234968:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918351232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.234999:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918351232:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.235006:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601532.235052:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918350720:0@lo:400:kworker.0 00010000:00080000:1.0:1789601532.235175:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc91880 x1876532918351232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601532.235188:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918351232:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235216:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350848 00000100:00100000:1.0:1789601532.235220:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350848 00000100:00100000:1.0:1789601532.235250:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351360 00000100:00100000:1.0:1789601532.235253:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351360 00000100:00100000:1.0:1789601532.235276:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789601532.235283:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918350848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235330:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918350848:12345-0@lo:400:kworker.0 Request processed in 46us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.235336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789601532.235349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601532.235355:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918351360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235381:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918351360:12345-0@lo:400:kworker.0 Request processed in 26us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.235386:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601532.235415:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918350848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918351360:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918351104:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.235524:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918351616:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.235544:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.235582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601532.235590:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918350976:0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.235642:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351744 00000100:00100000:3.0:1789601532.235662:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351104 00000100:00100000:3.0:1789601532.235665:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351104 00000100:00100000:3.0:1789601532.235677:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351616 00000100:00100000:3.0:1789601532.235679:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351616 00000100:00100000:3.0:1789601532.235691:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789601532.235698:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.235739:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918351744:12345-0@lo:400:kworker.0 Request processed in 41us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601532.235745:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789601532.235758:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789601532.235764:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918351104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.235791:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918351104:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601532.235797:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789601532.235808:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789601532.235822:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918351616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601532.235847:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918351616:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601532.235852:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789601532.235868:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601532.235873:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601532.235875:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601532.235896:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918351744:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236128:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601532.236157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918351488:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789601532.236203:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92d80 x1876532918351104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601532.236213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918351104:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236223:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918351616:0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918350976 00000100:00100000:1.0:1789601532.236260:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918350976 00000100:00100000:1.0:1789601532.236288:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351488 00000100:00100000:1.0:1789601532.236291:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351488 00000100:00100000:1.0:1789601532.236307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789601532.236313:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236348:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918350976:12345-0@lo:400:kworker.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.236353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789601532.236364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789601532.236369:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918351488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601532.236392:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918351488:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.236398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1789601532.236426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92300 x1876532918350976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601532.236435:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918350976:0@lo:400:kworker.0 00010000:00080000:1.0:1789601532.236445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5480380 x1876532918351488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601532.236453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918351488:0@lo:400:kworker.0 00000100:00080000:3.0:1789601532.236775:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601532.239197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601532.239212:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918350464:12345-0@lo:400:kworker.0 Request processed in 8239us (9126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601532.239227:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00010000:0.0:1789601532.549823:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601532.741767:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601532.741767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601532.741797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918351872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601532.741797:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918352000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601532.741980:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.742050:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918351872 00000100:00100000:2.0:1789601532.742061:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918351872 00000100:00100000:2.0:1789601532.742127:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789601532.742140:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918351872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601532.742181:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601532.742248:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918351872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601532.742253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601532.742261:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789601532.742280:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352000 00000100:00100000:2.0:1789601532.742283:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352000 00000100:00100000:2.0:1789601532.742298:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789601532.742304:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918352000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601532.742314:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601532.742362:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918352000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601532.742368:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1789601532.742412:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5480380 x1876532918351872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601532.742433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918351872:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789601532.742629:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36a8a80 x1876532918352000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601532.742655:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918352000:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789601532.872641:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789601532.874529:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601533.574258:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601533.735855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601533.735903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601533.735990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330624 00000100:00100000:3.0:1789601533.736003:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330624 00000100:00100000:3.0:1789601533.736084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 378 00000100:00100000:3.0:1789601533.736096:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898330624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601533.736185:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898330624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601533.736193:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 378 00000100:00100000:2.0:1789601533.736393:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601533.736868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330880 00000100:00100000:1.0:1789601533.736874:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330880 00000100:00100000:1.0:1789601533.736934:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898330752 00000100:00100000:1.0:1789601533.736937:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898330752 00000100:00100000:1.0:1789601533.736963:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 269 00000100:00100000:1.0:1789601533.736971:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330880:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601533.737029:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330880:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 60us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601533.737037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 269 00000100:00100000:1.0:1789601533.737051:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 270 00000100:00100000:1.0:1789601533.737057:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330752:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601533.737083:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898330752:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601533.737089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 270 00000100:00080000:3.0:1789601533.737309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601533.737315:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601533.749266:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601533.749300:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601533.749372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601533.749583:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331136 00000100:00100000:3.0:1789601533.749596:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331136 00000100:00100000:3.0:1789601533.749671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331264 00000100:00100000:3.0:1789601533.749675:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331264 00000100:00100000:3.0:1789601533.749703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 271 00000100:00100000:3.0:1789601533.749716:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898331136:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601533.749817:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898331136:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 103us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601533.749825:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 271 00000100:00100000:3.0:1789601533.749845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 272 00000100:00100000:3.0:1789601533.749852:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898331264:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601533.749878:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898331264:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601533.749884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 272 00000100:00100000:2.0:1789601533.749887:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331008 00000100:00100000:2.0:1789601533.749892:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331008 00000100:00100000:2.0:1789601533.749929:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1789601533.749937:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898331008:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:2.0:1789601533.749974:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f174e 00000100:00080000:2.0:1789601533.749994:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8df3c354e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601533.750286:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1789601533.751156:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601533.751157:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+2:2414:x1876532898331008:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 1215us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601533.751170:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00080000:0.0:1789601533.751386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601533.751393:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601533.751396:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601534.277955:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918352128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601534.277970:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601534.277992:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918352256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601534.278059:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601534.278183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601534.278305:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352128 00000100:00100000:3.0:1789601534.278316:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352128 00000100:00100000:0.0:1789601534.278404:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352256 00000100:00100000:0.0:1789601534.278409:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352256 00000100:00100000:3.0:1789601534.278479:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789601534.278504:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918352128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601534.278541:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601534.278624:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918352128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601534.278633:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789601534.278667:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918352128:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789601534.278724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601534.278850:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789601534.278858:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918352256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789601534.278870:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601534.278915:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918352256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601534.278922:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789601534.278998:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918352256:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789601534.598194:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601535.303070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918352384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601535.303210:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601535.303295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352384 00000100:00100000:1.0:1789601535.303307:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352384 00000100:00100000:1.0:1789601535.303375:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789601535.303387:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918352384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601535.303432:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601535.303514:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918352384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601535.303532:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789601535.303767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918352384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601535.622119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601535.815612:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601535.815643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918352512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601535.815736:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601535.816124:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352512 00000100:00100000:2.0:1789601535.818391:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352512 00000100:00100000:2.0:1789601535.818504:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789601535.818517:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918352512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601535.818589:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601535.818694:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918352512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601535.818701:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789601535.818832:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918352512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789601536.649173:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601537.349947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918352896:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918353408:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350145:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350184:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918353920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350233:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789601537.350238:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918352768:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350299:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918353280:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350338:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350370:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918353792:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.350394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601537.350423:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353408 00000100:00100000:0.0:1789601537.350433:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353408 00000100:00080000:1.0:1789601537.350592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601537.350608:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352896 00000100:00100000:1.0:1789601537.350612:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352896 00000100:00100000:1.0:1789601537.350658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789601537.350669:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918352896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.350739:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918352896:12345-0@lo:400:kworker.0 Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.350746:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789601537.350771:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353920 00000100:00100000:1.0:1789601537.350774:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353920 00000100:00100000:1.0:1789601537.350801:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352768 00000100:00100000:1.0:1789601537.350805:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352768 00000100:00100000:1.0:1789601537.350816:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353280 00000100:00100000:1.0:1789601537.350819:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353280 00000100:00100000:1.0:1789601537.350830:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353792 00000100:00100000:1.0:1789601537.350833:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353792 00000100:00100000:1.0:1789601537.350853:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789601537.350860:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918353920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.350894:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918353920:12345-0@lo:400:kworker.0 Request processed in 34us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.350901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789601537.350912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789601537.350918:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918352768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.350944:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918352768:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.350950:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789601537.350970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789601537.350975:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918353280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.351002:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918353280:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.351009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789601537.351019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789601537.351024:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.351049:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918353792:12345-0@lo:400:kworker.0 Request processed in 24us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.351055:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1789601537.351068:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601537.351071:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601537.351122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918352768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.351133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918353280:0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.351143:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918353792:0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.351154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918352896:0@lo:400:kworker.0 00010000:00080000:1.0:1789601537.351167:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5487480 x1876532918353920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601537.351178:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918353920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.351494:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789601537.351502:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918353408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918353024:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351685:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918353536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351710:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351730:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918354048:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351777:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789601537.351785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918352640:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351816:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351842:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918353152:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351885:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918353664:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351920:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918354176:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.351957:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.351987:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353536 00000100:00100000:2.0:1789601537.351993:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353536 00000100:00100000:2.0:1789601537.352024:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354048 00000100:00100000:2.0:1789601537.352026:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354048 00000100:00100000:2.0:1789601537.352039:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353664 00000100:00100000:2.0:1789601537.352040:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353664 00000100:00100000:2.0:1789601537.352051:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354176 00000100:00100000:2.0:1789601537.352054:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354176 00000100:00100000:2.0:1789601537.352066:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789601537.352072:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918353536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.352108:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918353536:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601537.352114:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789601537.352131:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789601537.352136:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918354048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.352262:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918354048:12345-0@lo:400:kworker.0 Request processed in 125us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601537.352269:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789601537.352284:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789601537.352290:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918353664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601537.352373:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353024 00000100:00100000:3.0:1789601537.352378:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353024 00000100:00100000:3.0:1789601537.352403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789601537.352410:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918353024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.352503:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789601537.352511:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918354176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.355222:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918353408:12345-0@lo:400:kworker.0 Request processed in 3707us (5062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601537.355241:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:0.0:1789601537.355331:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5485180 x1876532918353408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601537.355349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918353408:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.355421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918352640 00000100:00100000:0.0:1789601537.355430:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918352640 00000100:00100000:0.0:1789601537.355499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789601537.355508:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918352640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.357439:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918352640:12345-0@lo:400:kworker.0 Request processed in 1921us (5609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601537.357722:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789601537.357813:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918353152 00000100:00100000:0.0:1789601537.357821:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918353152 00000100:00100000:0.0:1789601537.357876:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601537.357885:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918353152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.358213:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918353664:12345-0@lo:400:kworker.0 Request processed in 5921us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601537.358225:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789601537.358261:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601537.358275:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601537.358314:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918352640:0@lo:400:kworker.0 00010000:00080000:2.0:1789601537.358334:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5487800 x1876532918353664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601537.358347:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918353664:0@lo:400:kworker.0 00010000:00080000:2.0:1789601537.358361:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5485880 x1876532918353536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601537.358371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918353536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601537.358383:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918354048:0@lo:400:kworker.0 00000100:00100000:3.0:1789601537.358577:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918353024:12345-0@lo:400:kworker.0 Request processed in 6165us (6909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601537.358595:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789601537.358684:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918353024:0@lo:400:kworker.0 00000100:00100000:1.0:1789601537.358962:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918354176:12345-0@lo:400:kworker.0 Request processed in 6450us (7002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601537.358981:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789601537.359051:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918354176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601537.359218:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918353152:12345-0@lo:400:kworker.0 Request processed in 1334us (7350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601537.359227:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789601537.359286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918353152:0@lo:400:kworker.0 00010000:00010000:0.0:1789601537.670083:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601537.866669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918354432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601537.866669:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918354304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601537.866879:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.866970:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354432 00000100:00100000:2.0:1789601537.866979:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354432 00000100:00100000:2.0:1789601537.867033:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789601537.867044:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918354432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601537.867080:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601537.867138:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918354432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601537.867146:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1789601537.867195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c280aa00 x1876532918354432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601537.867231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918354432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601537.868025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601537.868138:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354304 00000100:00100000:2.0:1789601537.868145:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354304 00000100:00100000:2.0:1789601537.868183:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789601537.868191:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918354304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601537.868206:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601537.868287:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918354304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601537.868295:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1789601537.868785:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5483480 x1876532918354304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601537.868871:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918354304:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601538.694208:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601538.850165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601538.850218:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601538.850274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601538.850296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331520 00000100:00100000:0.0:1789601538.850307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601538.850312:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331520 00000100:00100000:0.0:1789601538.850351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601538.850385:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331776 00000100:00100000:1.0:1789601538.850390:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331776 00000100:00100000:1.0:1789601538.850405:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331648 00000100:00100000:1.0:1789601538.850408:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331648 00000100:00100000:3.0:1789601538.851060:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331392 00000100:00100000:3.0:1789601538.851068:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331392 00000100:00100000:3.0:1789601538.851111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 380 00000100:00100000:3.0:1789601538.851124:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898331392:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601538.851219:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c3cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898331392:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 97us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601538.851226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 380 00000100:00100000:3.0:1789601538.851273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898331904 00000100:00100000:3.0:1789601538.851277:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898331904 00000100:00100000:1.0:1789601538.851588:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:1.0:1789601538.851598:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898331520:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601538.851638:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898331520:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601538.851646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:1.0:1789601538.851660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 280 00000100:00100000:1.0:1789601538.851666:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898331776:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601538.851691:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898331776:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601538.851698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 280 00000100:00100000:1.0:1789601538.851710:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00100000:1.0:1789601538.851716:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898331648:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601538.851758:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898331648:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 42us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601538.851763:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00080000:2.0:1789601538.857604:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601538.857621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601538.864704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 282 00000100:00100000:3.0:1789601538.864723:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898331904:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601538.864845:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898331904:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 128us (14493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601538.864854:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 282 00000100:00100000:0.0:1789601539.398142:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601539.398175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918354560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601539.398267:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601539.399803:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354560 00000100:00100000:1.0:1789601539.399820:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354560 00000100:00100000:1.0:1789601539.399916:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789601539.399932:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918354560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601539.399983:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601539.400077:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918354560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601539.400085:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789601539.400149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918354560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789601539.400294:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601539.403162:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601539.403197:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918354688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601539.403291:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601539.404986:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354688 00000100:00100000:3.0:1789601539.405003:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354688 00000100:00100000:3.0:1789601539.405102:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601539.405114:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918354688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601539.405147:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601539.405244:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918354688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601539.405252:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789601539.405529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601539.405780:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918354688:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789601539.719357:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789601539.923816:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:1.0:1789601539.923826:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df3c3549000/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:3.0:1789601539.924147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c3549000/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-OST0001 00000020:00000080:3.0:1789601539.924208:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c354e000 for lustre-OST0001 00000100:00100000:3.0:1789601540.421922:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601540.421945:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918354816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601540.422012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601540.422308:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354816 00000100:00100000:2.0:1789601540.422316:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354816 00000100:00100000:2.0:1789601540.422372:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601540.422380:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918354816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601540.422412:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601540.422474:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918354816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601540.422481:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601540.422599:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918354816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601540.750587:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601540.934505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601540.934534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918354944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601540.934659:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601540.934740:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918354944 00000100:00100000:2.0:1789601540.934748:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918354944 00000100:00100000:2.0:1789601540.934815:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601540.934826:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918354944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601540.934872:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601540.934924:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918354944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601540.934931:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601540.935237:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918354944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601541.765975:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601542.092346:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789601542.094380:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601542.470685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918355456:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.470792:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.470859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918355968:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.470888:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.470911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918356480:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.470935:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.470963:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789601542.470970:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918355328:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.470987:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918355072:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.470996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918355840:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471025:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471045:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601542.471048:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918355584:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918356352:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471069:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601542.471085:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918356096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471104:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355968 00000100:00100000:1.0:1789601542.471104:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471114:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355968 00000100:00100000:1.0:1789601542.471119:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918356608:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471150:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601542.471167:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789601542.471171:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356480 00000100:00100000:1.0:1789601542.471172:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918355200:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471173:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356480 00000100:00100000:3.0:1789601542.471187:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356096 00000100:00100000:3.0:1789601542.471190:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356096 00000100:00100000:1.0:1789601542.471193:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471202:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356608 00000100:00100000:3.0:1789601542.471205:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356608 00000100:00100000:1.0:1789601542.471208:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918355712:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471221:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789601542.471227:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601542.471231:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918355968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471236:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918356224:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601542.471278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355328 00000100:00100000:1.0:1789601542.471281:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355328 00000100:00100000:3.0:1789601542.471300:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918355968:12345-0@lo:400:kworker.0 Request processed in 70us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601542.471309:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789601542.471321:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355584 00000100:00100000:1.0:1789601542.471323:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355584 00000100:00100000:3.0:1789601542.471327:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789601542.471332:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471336:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789601542.471342:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918355328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471360:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918356480:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601542.471367:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789601542.471370:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918355328:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601542.471376:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789601542.471376:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601542.471381:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918356096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789601542.471391:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918355584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.471408:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918356096:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.471413:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918355584:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601542.471414:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789601542.471418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789601542.471437:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789601542.471443:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918356608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.471451:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355456 00000100:00100000:1.0:1789601542.471454:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355456 00000100:00100000:3.0:1789601542.471470:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918356608:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.471473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355840 00000100:00100000:1.0:1789601542.471475:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355840 00000100:00100000:3.0:1789601542.471476:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789601542.471486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356352 00000100:00100000:3.0:1789601542.471491:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355200 00000100:00100000:3.0:1789601542.471494:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355200 00000100:00100000:1.0:1789601542.471494:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356352 00000100:00100000:3.0:1789601542.471507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355712 00000100:00100000:1.0:1789601542.471508:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356224 00000100:00100000:3.0:1789601542.471510:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355712 00000100:00100000:1.0:1789601542.471510:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356224 00000100:00100000:3.0:1789601542.471522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789601542.472589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789601542.472607:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918355840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.472992:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918355840:12345-0@lo:400:kworker.0 Request processed in 392us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.473001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789601542.473020:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789601542.473035:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918355200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473062:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918355456:12345-0@lo:400:kworker.0 Request processed in 1534us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.473062:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918355200:12345-0@lo:400:kworker.0 Request processed in 28us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.473068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789601542.473084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789601542.473091:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918356352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789601542.473110:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789601542.473117:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473118:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918356352:12345-0@lo:400:kworker.0 Request processed in 28us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.473123:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789601542.473133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789601542.473139:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473157:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918355712:12345-0@lo:400:kworker.0 Request processed in 41us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.473162:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918356224:12345-0@lo:400:kworker.0 Request processed in 24us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601542.473163:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789601542.473167:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789601542.473213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918355328:0@lo:400:kworker.0 00010000:00080000:3.0:1789601542.473230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31b8700 x1876532918355840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601542.473242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918355840:0@lo:400:kworker.0 00010000:00080000:3.0:1789601542.473253:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318ce00 x1876532918356352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601542.473262:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918356352:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918355456:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918355200:0@lo:400:kworker.0 00010000:00080000:3.0:1789601542.473285:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c31bb480 x1876532918355968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601542.473294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918355968:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473303:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918355712:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918356480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473324:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918356224:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473333:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918355584:0@lo:400:kworker.0 00010000:00080000:1.0:1789601542.473344:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c318f480 x1876532918356096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601542.473352:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918356096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601542.473363:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918356608:0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.473384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918355072 00000100:00100000:3.0:1789601542.473391:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918355072 00000100:00100000:3.0:1789601542.473440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789601542.476211:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918355072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601542.476351:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918355072:12345-0@lo:400:kworker.0 Request processed in 160us (5324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601542.476507:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918355072:0@lo:400:kworker.0 00000100:00080000:0.0:1789601542.476614:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601542.476621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601542.476625:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601542.476629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601542.482276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1789601542.790926:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601542.981924:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918356736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601542.982123:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601542.982471:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356736 00000100:00100000:1.0:1789601542.982482:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356736 00000100:00100000:1.0:1789601542.982545:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789601542.982577:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918356736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601542.982615:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601542.982675:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918356736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601542.982694:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1789601542.982820:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5481500 x1876532918356736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601542.982842:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918356736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601542.991135:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601542.991165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918356864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601542.991254:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601542.991320:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356864 00000100:00100000:0.0:1789601542.991329:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356864 00000100:00100000:0.0:1789601542.991384:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789601542.991394:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918356864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601542.991438:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601542.991498:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918356864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601542.991506:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1789601542.991609:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d0103800 x1876532918356864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601542.991631:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918356864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601543.813938:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601543.969444:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601543.969575:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332032 00000100:00100000:2.0:1789601543.969589:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332032 00000100:00100000:2.0:1789601543.969649:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 382 00000100:00100000:2.0:1789601543.969661:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898332032:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601543.969751:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898332032:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601543.969759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 382 00000100:00100000:2.0:1789601543.976541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601543.976617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601543.976635:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601543.976667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601543.976701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332160 00000100:00100000:2.0:1789601543.976713:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332160 00000100:00100000:2.0:1789601543.976779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332416 00000100:00100000:2.0:1789601543.976782:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332416 00000100:00100000:2.0:1789601543.976795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332288 00000100:00100000:2.0:1789601543.976810:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332288 00000100:00100000:2.0:1789601543.976826:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332544 00000100:00100000:2.0:1789601543.976829:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332544 00000100:00100000:2.0:1789601543.976845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:2.0:1789601543.976855:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898332160:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601543.976967:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898332160:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601543.976975:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:2.0:1789601543.976998:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 290 00000100:00100000:2.0:1789601543.977005:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898332416:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601543.977033:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898332416:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601543.977039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 290 00000100:00100000:2.0:1789601543.977053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00100000:2.0:1789601543.977073:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898332288:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601543.977099:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898332288:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601543.977105:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00100000:2.0:1789601543.977117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 292 00000100:00100000:2.0:1789601543.977124:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898332544:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601543.977149:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898332544:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601543.977156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 292 00000100:00080000:2.0:1789601543.977181:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601543.977186:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601544.518466:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918356992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601544.518598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601544.518746:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918356992 00000100:00100000:1.0:1789601544.518767:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918356992 00000100:00100000:1.0:1789601544.518839:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789601544.518851:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918356992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601544.518889:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601544.518940:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918356992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601544.518948:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789601544.519069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601544.519132:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918356992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601544.519768:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918357120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601544.519811:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601544.520031:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357120 00000100:00100000:3.0:1789601544.520038:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357120 00000100:00100000:3.0:1789601544.520102:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789601544.520111:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918357120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601544.520126:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789601544.520227:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601544.521007:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918357120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 895us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601544.521019:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789601544.531260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918357120:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789601544.837913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601545.544669:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601545.544702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918357248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601545.544799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601545.544996:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357248 00000100:00100000:2.0:1789601545.545007:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357248 00000100:00100000:2.0:1789601545.545155:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789601545.545168:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918357248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601545.545222:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601545.545293:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918357248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601545.545301:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789601545.545349:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918357248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601545.862014:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601546.054045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918357376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601546.054220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601546.059531:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357376 00000100:00100000:2.0:1789601546.059590:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357376 00000100:00100000:2.0:1789601546.059685:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789601546.059698:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918357376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601546.059766:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601546.060366:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918357376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 669us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601546.060376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789601546.065137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918357376:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789601546.886759:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601546.982200:0:14066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:32:24 (1789601544) 00000100:00100000:0.0:1789601547.589882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918357504:0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.590006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601547.590087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918358016:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.590223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918357632:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.590265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.590290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918358144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.590311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.590326:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918358656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.590344:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.590365:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789601547.590372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918357760:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.590415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.590438:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918358272:0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.590479:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.590492:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601547.590528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918358528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.590606:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357632 00000100:00100000:1.0:1789601547.590616:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357632 00000100:00100000:1.0:1789601547.590664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358144 00000100:00100000:1.0:1789601547.590667:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358144 00000100:00100000:1.0:1789601547.590693:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358656 00000100:00100000:1.0:1789601547.590695:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358656 00000100:00100000:1.0:1789601547.590707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358272 00000100:00100000:1.0:1789601547.590709:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358272 00000100:00100000:1.0:1789601547.590725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789601547.590735:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918357632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601547.590953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918357888:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.593307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918358784:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.593397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.596450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357504 00000100:00100000:0.0:1789601547.596456:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.596467:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357504 00000100:00100000:3.0:1789601547.596568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789601547.596582:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.596664:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918357632:12345-0@lo:400:kworker.0 Request processed in 5927us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601547.596667:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918357504:12345-0@lo:400:kworker.0 Request processed in 88us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601547.596682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789601547.596686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789601547.596714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358784 00000100:00100000:1.0:1789601547.596718:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358784 00000100:00100000:3.0:1789601547.596737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789601547.596750:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.596753:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789601547.596764:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918358656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.596822:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918358144:12345-0@lo:400:kworker.0 Request processed in 74us (6507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.596823:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918358656:12345-0@lo:400:kworker.0 Request processed in 60us (6476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601547.596841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789601547.596875:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918359040:0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.596920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601547.596964:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918357504:0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.597006:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357760 00000100:00100000:0.0:1789601547.597011:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357760 00000100:00100000:0.0:1789601547.597041:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358016 00000100:00100000:0.0:1789601547.597044:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358016 00000100:00100000:0.0:1789601547.597058:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601547.597064:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918357760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.597103:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918357760:12345-0@lo:400:kworker.0 Request processed in 38us (6695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601547.597110:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601547.597125:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601547.597132:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918358016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.597170:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918358016:12345-0@lo:400:kworker.0 Request processed in 39us (6693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.597189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789601547.597206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789601547.597232:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918358272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597265:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918358272:12345-0@lo:400:kworker.0 Request processed in 35us (6774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.597271:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789601547.597284:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789601547.597290:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918358784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597315:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918358784:12345-0@lo:400:kworker.0 Request processed in 25us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.597321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789601547.597340:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358528 00000100:00100000:1.0:1789601547.597343:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358528 00000100:00100000:1.0:1789601547.597369:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359040 00000100:00100000:1.0:1789601547.597372:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359040 00000100:00100000:1.0:1789601547.597404:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789601547.597411:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597444:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918358528:12345-0@lo:400:kworker.0 Request processed in 34us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.597450:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789601547.597462:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789601547.597468:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918359040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597500:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918359040:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.597506:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789601547.597519:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918357760:0@lo:400:kworker.0 00000100:00080000:1.0:1789601547.597598:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601547.597603:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601547.597607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601547.597610:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789601547.597619:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5487800 x1876532918358272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601547.597633:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918358272:0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597651:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918358016:0@lo:400:kworker.0 00010000:00080000:3.0:1789601547.597654:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5484a80 x1876532918358784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789601547.597672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5485180 x1876532918358528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601547.597682:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918358528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.597692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918359040:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.597734:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918358784:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.597812:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918357632:0@lo:400:kworker.0 00000100:00100000:0.0:1789601547.597819:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789601547.597846:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918358144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.597861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918358656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.597933:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.597967:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918358400:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.597996:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601547.598026:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918358912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.598044:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918357888 00000100:00100000:3.0:1789601547.598050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601547.598051:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918357888 00000100:00100000:3.0:1789601547.598079:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358400 00000100:00100000:3.0:1789601547.598085:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358400 00000100:00100000:1.0:1789601547.598089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789601547.598097:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918357888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.598134:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918357888:12345-0@lo:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.598141:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789601547.598624:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918358912 00000100:00100000:3.0:1789601547.598630:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918358912 00000100:00100000:3.0:1789601547.598730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789601547.598739:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918358400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789601547.598758:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601547.598763:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601547.598790:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789601547.598800:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918358912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601547.599280:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918358912:12345-0@lo:400:kworker.0 Request processed in 480us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601547.599288:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601547.604365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918357888:0@lo:400:kworker.0 00000100:00100000:2.0:1789601547.606572:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918358912:0@lo:400:kworker.0 00000100:00100000:3.0:1789601547.610044:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918358400:12345-0@lo:400:kworker.0 Request processed in 11289us (12029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601547.610066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1789601547.610356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5487b80 x1876532918358400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601547.610377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918358400:0@lo:400:kworker.0 00010000:00010000:0.0:1789601547.909796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601548.101954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918359168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601548.102060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601548.102189:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359168 00000100:00100000:1.0:1789601548.102200:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359168 00000100:00100000:1.0:1789601548.102267:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789601548.102279:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918359168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601548.102319:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601548.102438:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918359296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601548.104578:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918359168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2266us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601548.104610:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1789601548.104899:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d0101500 x1876532918359168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601548.104926:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918359168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601548.108328:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601548.116995:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359296 00000100:00100000:0.0:1789601548.117018:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359296 00000100:00100000:0.0:1789601548.117213:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789601548.117225:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918359296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601548.117259:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601548.117373:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918359296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (9056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601548.117415:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1789601548.117512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c5485f80 x1876532918359296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601548.117536:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918359296:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789601548.935152:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601548.969373:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601548.969553:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332672 00000100:00100000:1.0:1789601548.969593:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332672 00000100:00080000:0.0:1789601548.969671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601548.969702:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789601548.969716:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:11113:x1876532898332672:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601548.969743:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601548.969773:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f182e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ab8 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.969875:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.969893:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.969909:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601548.969986:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789601548.969991:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601548.970039:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.970070:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f182e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab8 expref: 7 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.970104:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab8 expref: 6 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601548.970134:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8955800) 00010000:00010000:1.0:1789601548.970138:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601548.970143:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eec00, rc 0) 00000100:00100000:1.0:1789601548.970225:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:11113:x1876532898332672:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 513us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601548.970234:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789601548.984688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601548.984852:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332800 00000100:00100000:3.0:1789601548.984867:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332800 00000100:00100000:3.0:1789601548.984955:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789601548.984986:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:11114:x1876532898332800:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601548.985018:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601548.985044:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f183c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48abf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985144:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985162:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985177:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985195:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985203:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985211:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985285:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985294:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985303:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601548.985368:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601548.985387:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601548.985653:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985667:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985674:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985682:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985689:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601548.985694:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985702:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985717:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8955800) 00010000:00010000:3.0:1789601548.985722:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601548.985729:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985736:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1843 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985752:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985769:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985776:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985781:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601548.985785:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985792:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985800:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df4f5eb2600) 00010000:00010000:3.0:1789601548.985803:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601548.985806:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985813:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f184a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985853:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f183c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48abf expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985869:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48abf expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601548.985877:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df4f5eb2900) 00010000:00010000:3.0:1789601548.985880:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601548.985889:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529a00, rc 0) 00000100:00100000:3.0:1789601548.986111:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:11114:x1876532898332800:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1127us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601548.986121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789601549.001627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601549.001832:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898332928 00000100:00100000:0.0:1789601549.001845:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898332928 00000100:00100000:0.0:1789601549.001921:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789601549.001934:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af09a131-8cce-462c-8c01-5d48daa688cf+7:11114:x1876532898332928:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789601549.002050:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af09a131-8cce-462c-8c01-5d48daa688cf+7:11114:x1876532898332928:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601549.002059:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1789601549.023689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601549.024105:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333184 00000100:00100000:2.0:1789601549.024120:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333184 00000100:00100000:2.0:1789601549.024197:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789601549.024210:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:11114:x1876532898333184:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601549.024240:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601549.024266:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1858 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ac6 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024359:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024387:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024410:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024429:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024437:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.024445:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.027227:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f186d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.027259:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f186d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.027274:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f186d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601549.027290:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789601549.028538:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.028553:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030285:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030294:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601549.030300:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030311:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030332:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df4f5eb2900) 00010000:00010000:2.0:1789601549.030336:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601549.030342:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030724:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f185f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030749:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030757:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030762:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030767:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601549.030770:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030776:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030784:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df4c4dbca00) 00010000:00010000:2.0:1789601549.030787:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601549.030790:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.030795:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1866 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.035112:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1858 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ac6 expref: 10 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.035148:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f186d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ac6 expref: 9 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601549.035174:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:2.0:1789601549.035178:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601549.035182:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382600, rc 0) 00000100:00100000:2.0:1789601549.035291:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:11114:x1876532898333184:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 11082us (11616us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789601549.035302:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:1.0:1789601549.056861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601549.057028:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333312 00000100:00100000:3.0:1789601549.057042:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333312 00000100:00100000:2.0:1789601549.060320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1789601549.060353:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:11114:x1876532898333312:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789601549.060548:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:11114:x1876532898333312:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 211us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601549.060577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789601549.067985:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601549.068676:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333440 00000100:00100000:1.0:1789601549.068690:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333440 00000100:00100000:1.0:1789601549.068801:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789601549.068816:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:11114:x1876532898333440:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789601549.071610:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789601549.074384:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5492us 00000100:00100000:3.0:1789601549.093016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601549.094496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601549.094553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601549.094612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333824 00000100:00100000:3.0:1789601549.094626:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333824 00000100:00100000:3.0:1789601549.094704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333696 00000100:00100000:3.0:1789601549.094708:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333696 00000100:00100000:3.0:1789601549.094732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:3.0:1789601549.094744:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898333824:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601549.094844:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898333824:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601549.094852:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:3.0:1789601549.094873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 300 00000100:00100000:3.0:1789601549.094880:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898333696:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601549.094921:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898333696:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601549.094928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 300 00000100:00080000:3.0:1789601549.094954:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601549.094959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601549.107413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333568 00000100:00100000:2.0:1789601549.107433:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333568 00000100:00100000:2.0:1789601549.107500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 384 00000100:00100000:2.0:1789601549.107508:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898333568:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601549.107630:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898333568:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 120us (14722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601549.107638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 384 00000100:00100000:2.0:1789601549.124839:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:11114:x1876532898333440:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 56011us (56854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601549.124857:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000040:00080000:2.0:1789601549.256285:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789601549.256967:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601549.637950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601549.637994:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918359424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601549.638084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601549.638164:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359424 00000100:00100000:3.0:1789601549.638174:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359424 00000100:00100000:3.0:1789601549.638248:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1789601549.638538:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601549.638670:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918359424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601549.638709:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601549.638776:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918359424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601549.638784:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789601549.639092:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918359424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601549.649999:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918359552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601549.650105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601549.655672:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359552 00000100:00100000:2.0:1789601549.655690:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359552 00000100:00100000:2.0:1789601549.655777:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789601549.655790:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918359552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601549.655827:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789601549.656027:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601549.656134:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918359552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601549.656143:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789601549.665152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918359552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601549.961991:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601550.661901:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918359680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601550.662014:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601550.662490:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359680 00000100:00100000:0.0:1789601550.662502:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359680 00000100:00100000:0.0:1789601550.662600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789601550.662612:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918359680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601550.662660:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601550.672103:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918359680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9476us (10071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601550.672123:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789601550.679819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918359680:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601550.982814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601551.174888:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601551.174920:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918359808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601551.175011:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601551.175184:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918359808 00000100:00100000:2.0:1789601551.175203:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918359808 00000100:00100000:2.0:1789601551.175268:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789601551.175280:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918359808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601551.175323:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789601551.175394:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918359808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601551.175400:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789601551.175665:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918359808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601551.619843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601551.619952:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898333952 00000100:00100000:3.0:1789601551.619963:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898333952 00000100:00100000:3.0:1789601551.620028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789601551.620038:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:11156:x1876532898333952:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601551.620057:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789601551.620086:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789601551.620126:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f187b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48acd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620192:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620206:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620217:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620244:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620252:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620259:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620299:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620306:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620312:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620319:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601551.620322:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620329:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620340:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8955800) 00010000:00010000:3.0:1789601551.620343:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601551.620349:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620355:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620494:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620500:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620506:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620512:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601551.620515:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620521:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620529:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df4e0d94500) 00010000:00010000:3.0:1789601551.620531:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601551.620534:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620540:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1889 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620656:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f187b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48acd expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620666:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8955800) 00010000:00010000:3.0:1789601551.620669:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601551.620678:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f187b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48acd expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.620688:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528c00, rc 0) 00000100:00100000:3.0:1789601551.620747:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:11156:x1876532898333952:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 711us (911us total) trans 0 rc 301/301 00000100:00100000:3.0:1789601551.620755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789601551.625089:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601551.625138:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334208 00000100:00100000:3.0:1789601551.625149:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334208 00000100:00100000:3.0:1789601551.625220:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1789601551.625232:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:11156:x1876532898334208:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1789601551.625296:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601551.625323:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1835 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab8 expref: 9 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625340:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8955800) 00010000:00010000:3.0:1789601551.625350:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601551.625422:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625435:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625445:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625456:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625464:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.625489:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626073:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626085:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626091:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601551.626105:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000029dc7f6 reply state 000000005e32dd46 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626114:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626120:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601551.626123:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601551.626126:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601551.626130:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789601551.626137:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626145:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626151:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626157:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601551.626168:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626177:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626187:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601551.626189:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601551.626193:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626200:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1890 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601551.626215:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000029dc7f6 reply state 000000005e32dd46 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626224:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.626231:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df4e0d94c00) 00010000:00010000:3.0:1789601551.626233:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601551.626235:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789601551.626410:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+10:11156:x1876532898334208:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 1180us (1330us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789601551.626418:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:1.0:1789601551.698620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601551.698749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334336 00000100:00100000:3.0:1789601551.698759:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334336 00000100:00100000:3.0:1789601551.698820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789601551.698831:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+10:11164:x1876532898334336:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:3.0:1789601551.698856:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601551.698953:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f18a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ad4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699084:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699098:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601551.699139:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601551.699143:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601551.699182:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699279:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f18a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ad4 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699299:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ad4 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601551.699307:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601551.699310:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601551.699314:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528c00, rc 0) 00000100:00100000:3.0:1789601551.699543:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+11:11164:x1876532898334336:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 560us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601551.699552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:2.0:1789601551.758782:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.758903:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334464 00000100:00100000:1.0:1789601551.758914:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334464 00000100:00100000:1.0:1789601551.758973:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1789601551.758983:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+11:11170:x1876532898334464:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601551.759003:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601551.759025:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f18b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48adb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759103:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759115:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759126:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759133:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759140:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759230:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759239:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759263:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601551.759302:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789601551.759307:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601551.759347:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759373:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759380:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759387:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759392:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601551.759396:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759404:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:1.0:1789601551.759418:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601551.759423:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759429:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f18ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759455:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759462:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759468:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759473:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601551.759476:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759481:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759489:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df4e0d94c00) 00010000:00010000:1.0:1789601551.759491:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601551.759494:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759500:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f18c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759528:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f18b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48adb expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759542:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48adb expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.759621:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601551.759624:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789601551.759627:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef800, rc 0) 00000100:00100000:1.0:1789601551.759693:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+12:11170:x1876532898334464:12345-192.168.203.48@tcp:101:bash.0 Request processed in 711us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601551.759700:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:2.0:1789601551.764104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601551.764182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334720 00000100:00100000:0.0:1789601551.764191:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334720 00000100:00100000:0.0:1789601551.764254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1789601551.764265:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+12:11170:x1876532898334720:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601551.764298:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601551.764318:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f18cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ae2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764438:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764453:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764464:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764510:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764518:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.764526:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601551.764908:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789601551.765070:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765080:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765088:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765134:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765141:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765148:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765153:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601551.765157:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765165:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765176:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601551.765179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601551.765183:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765189:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f18d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601551.765202:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077083ed0 reply state 00000000a5f1a99d transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765212:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765218:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:0.0:1789601551.765230:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601551.765233:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789601551.765266:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f18cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765281:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.765288:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:0.0:1789601551.765290:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601551.765292:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467a00, rc 0) 00000100:00100000:0.0:1789601551.765351:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+15:11170:x1876532898334720:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1087us (1254us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789601551.765373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:2.0:1789601551.772686:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601551.773069:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334848 00000100:00100000:0.0:1789601551.773079:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334848 00000100:00100000:0.0:1789601551.773128:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601551.773137:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2414:x1876532898334848:12345-192.168.203.48@tcp:8:bash.0 00010000:00080000:0.0:1789601551.773169:0:8857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:0.0:1789601551.773200:0:8857:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f18f2 00002000:00100000:0.0:1789601551.773211:0:8857:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af09a131-8cce-462c-8c01-5d48daa688cf/ffff8df3c400e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601551.773227:0:8857:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601551.773298:0:8857:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789601551.773325:0:8857:0:(import.c:65:import_set_state_nolock()) ffff8df3c400b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601551.773400:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898334848:12345-192.168.203.48@tcp:8:bash.0 Request processed in 263us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601551.773408:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:2.0:1789601551.780848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.780955:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898334976 00000100:00100000:1.0:1789601551.780965:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898334976 00000100:00100000:1.0:1789601551.781045:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:1.0:1789601551.781055:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898334976:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601551.781072:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601551.781105:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ae9 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601551.781130:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601551.781148:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1789601551.781152:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601551.781161:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.781180:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.781201:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef600, rc 0) 00000100:00100000:1.0:1789601551.781255:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:0:x1876532898334976:12345-192.168.203.48@tcp:101:bash.0 Request processed in 201us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601551.781278:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00080000:0.0:1789601551.781481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601551.785806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.785902:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898335104 00000100:00100000:1.0:1789601551.785912:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898335104 00000100:00100000:1.0:1789601551.785966:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789601551.785975:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:11170:x1876532898335104:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601551.785991:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601551.786008:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48af0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.786039:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.786047:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601551.786051:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601551.786057:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.786086:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.786100:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 8 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601551.786113:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1876532918359936:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601551.786195:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c7e07a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601551.795276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601551.795668:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898335232 00000100:00100000:0.0:1789601551.795678:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898335232 00010000:00010000:0.0:1789601551.795717:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 9 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601551.795765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1789601551.795776:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3638850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898335232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601551.795792:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601551.795815:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 9 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.795828:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 9 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.795854:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601551.795859:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601551.795868:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.795879:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601551.795915:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601551.795929:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0103800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876532918360064:192.168.203.48@tcp:105: 00000100:00100000:0.0:1789601551.796068:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9832d80 going to sleep for 11 seconds 00010000:00010000:1.0:1789601551.796227:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f18f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae9 expref: 9 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601551.796244:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1876532918359936:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601551.796266:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.796277:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601551.796304:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:11170:x1876532898335104:12345-192.168.203.48@tcp:101:bash.0 Request processed in 10330us (10507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601551.796312:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:2.0:1789601551.809214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.810619:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898335488 00000100:00100000:1.0:1789601551.810633:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898335488 00000100:00100000:1.0:1789601551.810712:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1789601551.810723:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:11170:x1876532898335488:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:1.0:1789601551.811034:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11170:x1876532898335488:12345-192.168.203.48@tcp:35:bash.0 Request processed in 311us (1827us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789601551.811042:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789601551.814125:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0103800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876532918360064:192.168.203.48@tcp:105: 00010000:00010000:0.0:1789601551.814156:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601551.819683:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3638850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898335232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 23896us (24405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601551.819699:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:2.0:1789601551.883291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.883421:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898335744 00000100:00100000:1.0:1789601551.883430:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898335744 00000100:00100000:1.0:1789601551.883487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:1.0:1789601551.883497:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11180:x1876532898335744:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601551.883518:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601551.883537:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48af7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601551.883675:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789601551.883773:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1907 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.883786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:1.0:1789601551.883789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601551.883795:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601551.883809:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef600, rc 0) 00000100:00100000:1.0:1789601551.883880:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+17:11180:x1876532898335744:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 385us (597us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789601551.883888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1789601551.891137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601551.891243:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336000 00000100:00100000:1.0:1789601551.891253:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336000 00000100:00100000:1.0:1789601551.891306:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1789601551.891315:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+17:11180:x1876532898336000:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601551.891549:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:11180:x1876532898336000:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 234us (421us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789601551.891584:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00010000:00010000:1.0:1789601552.006907:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601552.029166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.029258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336128 00000100:00100000:0.0:1789601552.029268:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336128 00000100:00100000:0.0:1789601552.029327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1789601552.029337:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:11186:x1876532898336128:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601552.029371:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601552.029392:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48afe expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029455:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029468:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029480:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601552.029521:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789601552.029524:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601552.029544:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029612:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48afe expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029658:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48afe expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.029668:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601552.029671:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601552.029675:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601552.029738:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+19:11186:x1876532898336128:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 402us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601552.029746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:3.0:1789601552.040136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.040237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336384 00000100:00100000:1.0:1789601552.040247:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336384 00000100:00100000:1.0:1789601552.040307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789601552.040317:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+19:11186:x1876532898336384:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601552.040365:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601552.040385:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1923 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b05 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.040490:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f192a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.040504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f192a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.040517:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f192a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601552.040528:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789601552.040666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1923 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b05 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.040685:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f192a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b05 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.040694:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:1.0:1789601552.040697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601552.040701:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efc00, rc 0) 00000100:00100000:1.0:1789601552.040762:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:11186:x1876532898336384:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 446us (635us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789601552.040769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:2.0:1789601552.043682:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.043780:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336512 00000100:00100000:3.0:1789601552.043800:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336512 00000100:00100000:3.0:1789601552.043886:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1789601552.043907:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:2415:x1876532898336512:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601552.043925:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601552.043954:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f192a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b05 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.043978:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:3.0:1789601552.043984:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601552.044050:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+20:2415:x1876532898336512:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 154us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.044057:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601552.048849:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.048962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336768 00000100:00100000:0.0:1789601552.048972:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336768 00000100:00100000:0.0:1789601552.049040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1789601552.049051:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+20:11186:x1876532898336768:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601552.049073:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601552.049094:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1938 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b0c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.049195:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.049210:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.049221:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601552.049233:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789601552.049344:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1938 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b0c expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.049377:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b0c expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.049385:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:0.0:1789601552.049388:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789601552.049392:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466e00, rc 0) 00000100:00100000:0.0:1789601552.049449:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:11186:x1876532898336768:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 400us (610us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789601552.049456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:2.0:1789601552.061266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.061373:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898336896 00000100:00100000:1.0:1789601552.061385:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898336896 00000100:00100000:1.0:1789601552.061444:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789601552.061469:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2417:x1876532898336896:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:1.0:1789601552.061514:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.061534:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.061543:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789601552.061548:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601552.061552:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.061624:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.061639:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 7 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601552.061891:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918360192:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601552.062216:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c7e07c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601552.064975:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918360192:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601552.065007:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601552.071609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.071934:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337024 00000100:00100000:0.0:1789601552.071944:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337024 00002000:00100000:0.0:1789601552.071992:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8df3c3436680 x1876532898337024/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:148/0 lens 504/0 e 0 to 0 dl 1789601563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601552.072003:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3436680 with x1876532898337024 ext(0->12) 00010000:00010000:0.0:1789601552.072012:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 8 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.072029:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 8 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601552.072037:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c3436680 00000100:00100000:0.0:1789601552.072064:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789601552.072074:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898337024:12345-192.168.203.48@tcp:4:lfs.0 00000001:00100000:2.0:1789601552.087257:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000100:00100000:1.0:1789601552.093550:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898337024:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 21466us (21940us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789601552.093606:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:1.0:1789601552.093620:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8df3c3436680 x1876532898337024/t4294967300(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:148/0 lens 504/448 e 0 to 0 dl 1789601563 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789601552.093630:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3436680 with x1876532898337024 ext(0->12) 00010000:00010000:1.0:1789601552.093643:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.093661:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601552.093669:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c3436680 00000100:00100000:2.0:1789601552.096889:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.098592:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337152 00000100:00100000:1.0:1789601552.098605:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337152 00010000:00010000:1.0:1789601552.098652:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601552.098779:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:1.0:1789601552.098791:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898337152:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601552.098807:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789601552.098824:0:7465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789601552.098827:0:7465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789601551 00002000:00010000:1.0:1789601552.098829:0:7465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789601551 00002000:00010000:1.0:1789601552.098831:0:7465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789601551 00002000:00010000:1.0:1789601552.098834:0:7465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789601552.098839:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.098882:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.098906:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd86a31c/0x74872e3eca9f1900 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48af0 expref: 9 pid: 8440 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.098923:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601552.098928:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601552.098933:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.098942:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.098981:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601552.099046:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898337152:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 257us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601552.099053:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00010000:00010000:2.0:1789601552.101726:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101745:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101777:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101787:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101796:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101803:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601552.101807:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101816:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101858:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.101881:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036425b6e/0x74872e3eca9f194d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601552.101991:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2417:x1876532898336896:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 40520us (40729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.102001:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:2.0:1789601552.106156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.106320:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337408 00000100:00100000:3.0:1789601552.106329:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337408 00000100:00100000:3.0:1789601552.106386:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789601552.106395:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+22:11186:x1876532898337408:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:3.0:1789601552.106455:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b0c expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601552.106688:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789601552.106729:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789601552.107383:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1789601552.107419:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.107434:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.107451:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.107481:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.107495:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 26 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601552.107509:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876532918360320:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601552.108364:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12ded80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601552.123756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.123973:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876532918360320:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601552.124000:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601552.124074:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337536 00000100:00100000:0.0:1789601552.124094:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337536 00010000:00010000:0.0:1789601552.124132:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 27 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601552.124171:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1789601552.124180:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+27:2415:x1876532898337536:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601552.124313:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601552.124320:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 27 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124333:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 27 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124362:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f18e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ae2 expref: 27 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124379:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:0.0:1789601552.124385:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124394:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124402:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.124462:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601552.124515:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+26:2415:x1876532898337536:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 336us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601552.124532:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00010000:00010000:3.0:1789601552.129101:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.129119:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601552.129675:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789601552.129797:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1789601552.130281:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918360448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789601552.130350:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.130444:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601552.134030:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918360448 00000100:00100000:0.0:1789601552.134046:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918360448 00000100:00100000:1.0:1789601552.134450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789601552.134461:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876532918360448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789601552.134620:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601552.134734:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876532918360448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 275us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601552.134742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789601552.134831:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918360448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601552.135035:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789601552.135100:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918360576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789601552.135139:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.135166:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601552.135335:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918360576 00000100:00100000:1.0:1789601552.135341:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918360576 00000100:00100000:1.0:1789601552.135396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789601552.135404:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876532918360576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789601552.135509:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1876532918360576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (370us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789601552.135516:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789601552.135722:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918360576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601552.135761:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1789601552.135796:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135806:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135813:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135819:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.135823:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135830:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135844:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:3.0:1789601552.135846:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601552.135851:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.135857:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1954 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601552.136097:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789601552.136174:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789601552.136261:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420257703270ns, next at 421257625799ns, rc = 0 00000001:00080000:3.0:1789601552.136270:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789601552.136313:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df501e4f900) 00010000:00010000:3.0:1789601552.136316:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601552.136323:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f193f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b0c expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601552.136484:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:11186:x1876532898337408:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 30089us (30336us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789601552.136492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000020:00080000:3.0:1789601552.136497:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789601552.154424:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.154527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337664 00000100:00100000:1.0:1789601552.154537:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337664 00000100:00100000:1.0:1789601552.154639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:1.0:1789601552.154650:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:11186:x1876532898337664:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601552.154674:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601552.154697:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f195b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b13 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.154754:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f195b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b13 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.154768:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f195b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b13 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.154787:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:1.0:1789601552.154790:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601552.154793:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601552.155098:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+30:11186:x1876532898337664:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 449us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601552.155106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:2.0:1789601552.165387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.165489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898337920 00000100:00100000:0.0:1789601552.165498:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898337920 00000100:00100000:0.0:1789601552.165588:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789601552.165600:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0982850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+30:11186:x1876532898337920:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601552.165817:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0982850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+31:11186:x1876532898337920:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 219us (438us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789601552.165825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789601552.270885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.270980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898338176 00000100:00100000:0.0:1789601552.270990:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898338176 00000100:00100000:0.0:1789601552.271045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789601552.271054:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+31:11197:x1876532898338176:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601552.271077:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601552.271095:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b1a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601552.271201:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789601552.271294:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1962 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b1a expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.271308:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:0.0:1789601552.271311:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601552.271316:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b1a expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.271348:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466400, rc 0) 00000100:00100000:0.0:1789601552.271419:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+32:11197:x1876532898338176:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 366us (553us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789601552.271427:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1789601552.274643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.274744:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898338304 00000100:00100000:3.0:1789601552.274752:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898338304 00000100:00100000:3.0:1789601552.274807:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789601552.274816:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+32:11197:x1876532898338304:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1789601552.274897:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.274914:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.274926:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.274936:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.274943:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.274968:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275052:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275059:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275066:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601552.275115:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275126:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275133:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275140:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275146:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.275151:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275158:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275170:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601552.275178:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601552.275184:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275201:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1970 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275216:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275222:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275228:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275233:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.275236:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275242:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275249:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:3.0:1789601552.275252:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601552.275255:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275260:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1977 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275270:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275281:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275287:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275291:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.275294:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275301:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275307:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601552.275309:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601552.275312:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.275317:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f197e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601552.275492:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+32:11197:x1876532898338304:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 675us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.275500:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:2.0:1789601552.278964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.279127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898338560 00000100:00100000:0.0:1789601552.279137:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898338560 00000100:00100000:0.0:1789601552.279279:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1789601552.279292:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+32:11197:x1876532898338560:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601552.280053:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:11197:x1876532898338560:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 268us (602us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789601552.280062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000040:00080000:3.0:1789601552.326256:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789601552.327386:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789601552.358327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.358857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898338816 00000100:00100000:3.0:1789601552.358876:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898338816 00000100:00100000:3.0:1789601552.358944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789601552.358955:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+33:11200:x1876532898338816:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601552.359001:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601552.359025:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b21 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359099:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359114:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359126:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359139:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359145:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359152:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359254:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359263:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359271:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601552.359281:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789601552.359383:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359391:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359397:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359403:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.359407:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359413:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359425:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601552.359429:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601552.359433:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359441:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f198c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359455:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359461:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.359467:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360056:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601552.360060:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360067:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360077:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:3.0:1789601552.360079:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601552.360085:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360091:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1993 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360138:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1985 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360155:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.360164:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601552.360166:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601552.360168:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363a00, rc 0) 00000100:00100000:3.0:1789601552.360337:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+35:11200:x1876532898338816:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1383us (2019us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789601552.360346:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:2.0:1789601552.366838:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.366963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898338944 00000100:00100000:1.0:1789601552.366974:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898338944 00000100:00100000:1.0:1789601552.367037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:1.0:1789601552.367049:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:11200:x1876532898338944:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789601552.367120:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367136:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367146:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367178:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367193:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367200:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367205:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efe00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601552.367209:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367215:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:1.0:1789601552.367229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601552.367233:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.367254:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f19a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601552.367328:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:11200:x1876532898338944:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 281us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601552.367336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:2.0:1789601552.370456:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.370536:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898339200 00000100:00100000:3.0:1789601552.370594:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898339200 00000100:00100000:3.0:1789601552.370644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601552.370653:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:11200:x1876532898339200:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601552.370888:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+36:11200:x1876532898339200:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 235us (441us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789601552.370896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1789601552.684957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601552.685187:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898339456 00000100:00100000:2.0:1789601552.685196:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898339456 00000100:00100000:2.0:1789601552.685258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789601552.685269:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+36:11231:x1876532898339456:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789601552.685293:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601552.685313:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f19af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.685454:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.685470:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.685482:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601552.685493:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789601552.685664:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f19af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b28 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.685683:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b28 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.685691:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601552.685694:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601552.685698:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:2.0:1789601552.685775:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+38:11231:x1876532898339456:12345-192.168.203.48@tcp:101:cat.0 Request processed in 509us (829us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789601552.685782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789601552.691957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601552.691997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601552.692128:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898339840 00000100:00100000:1.0:1789601552.692138:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898339840 00000100:00100000:1.0:1789601552.692206:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1789601552.692217:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+38:2416:x1876532898339840:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601552.692234:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601552.692259:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b28 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601552.692279:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:1.0:1789601552.692284:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601552.692337:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+37:2416:x1876532898339840:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601552.692344:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789601552.692858:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898339712 00000100:00100000:3.0:1789601552.692873:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898339712 00000100:00100000:3.0:1789601552.692910:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601552.692918:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+37:11231:x1876532898339712:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:3.0:1789601552.693128:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+38:11231:x1876532898339712:12345-192.168.203.48@tcp:35:cat.0 Request processed in 210us (1181us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789601552.693136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601552.710047:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918360960:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710128:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710193:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918361472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710218:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710241:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918361984:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710263:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710287:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789601552.710293:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918361088:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710314:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710333:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918361600:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918362112:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710419:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.710450:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361984 00000100:00100000:3.0:1789601552.710457:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361984 00000100:00100000:3.0:1789601552.710512:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361600 00000100:00100000:3.0:1789601552.710516:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361600 00000100:00100000:3.0:1789601552.710534:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918362112 00000100:00100000:3.0:1789601552.710537:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918362112 00000100:00100000:3.0:1789601552.710552:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789601552.710604:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918361984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710658:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918361984:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.710665:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789601552.710684:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789601552.710689:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918361600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710715:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918361600:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.710720:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789601552.710732:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789601552.710738:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918362112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710763:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918362112:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.710769:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789601552.710807:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918361600:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710817:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918362112:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710826:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918361984:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.710856:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361472 00000100:00100000:3.0:1789601552.710979:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361472 00000100:00100000:3.0:1789601552.711006:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361088 00000100:00100000:3.0:1789601552.711009:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361088 00000100:00100000:3.0:1789601552.711029:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789601552.711035:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918361472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.711070:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918361472:12345-0@lo:400:kworker.0 Request processed in 35us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.711076:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789601552.711089:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789601552.711095:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918361088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.711123:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918361088:12345-0@lo:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.711128:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789601552.711154:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918361088:0@lo:400:kworker.0 00010000:00080000:3.0:1789601552.711166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc92300 x1876532918361472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601552.711176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918361472:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711292:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918360704:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601552.711377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918361216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601552.711423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918361728:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711442:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601552.711451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918360832:0@lo:400:kworker.0 00000100:00080000:0.0:1789601552.711471:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601552.711475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601552.711478:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601552.711480:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601552.711488:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918360960 00000100:00100000:0.0:1789601552.711491:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918360960 00000100:00100000:2.0:1789601552.711499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918361344:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711523:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361216 00000100:00100000:0.0:1789601552.711526:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361216 00000100:00100000:2.0:1789601552.711527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601552.711538:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789601552.711539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918361856:0@lo:400:kworker.0 00000100:00100000:0.0:1789601552.711544:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918360960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.711582:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601552.711601:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918360704 00000100:00100000:3.0:1789601552.711605:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918360704 00000100:00100000:2.0:1789601552.711607:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789601552.711613:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918361216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.711630:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789601552.711636:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918360704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.711646:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918361216:12345-0@lo:400:kworker.0 Request processed in 34us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.711651:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789601552.711661:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918360704:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601552.711667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789601552.711678:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918360704:0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.711687:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918361216:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.711702:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361728 00000100:00100000:2.0:1789601552.711702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918360832 00000100:00100000:3.0:1789601552.711705:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361728 00000100:00100000:2.0:1789601552.711705:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918360832 00000100:00100000:3.0:1789601552.711730:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361856 00000100:00100000:3.0:1789601552.711733:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361856 00000100:00100000:2.0:1789601552.711734:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918361344 00000100:00100000:2.0:1789601552.711736:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918361344 00000100:00100000:3.0:1789601552.711746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789601552.711751:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918360832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.711792:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918360832:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601552.712398:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918360960:12345-0@lo:400:kworker.0 Request processed in 852us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601552.712406:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789601552.712433:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601552.712437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601552.717277:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918360832:0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717323:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789601552.717340:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918361728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717445:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918361728:12345-0@lo:400:kworker.0 Request processed in 114us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.717453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789601552.717489:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918361728:0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789601552.717519:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918361856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717728:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918361856:12345-0@lo:400:kworker.0 Request processed in 40us (5999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.717752:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:2.0:1789601552.717784:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4fbc93b80 x1876532918361856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601552.717795:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918361856:0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717814:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789601552.717822:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918361344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717859:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918361344:12345-0@lo:400:kworker.0 Request processed in 39us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.717866:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789601552.717893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918361344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601552.717951:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918360960:0@lo:400:kworker.0 00000100:00100000:3.0:1789601552.721666:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789601552.751202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.751345:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340096 00000100:00100000:3.0:1789601552.751368:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340096 00000100:00100000:3.0:1789601552.751447:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789601552.751459:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+38:11237:x1876532898340096:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789601552.751492:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601552.751497:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789601552.751530:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f191c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48afe expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751552:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601552.751615:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601552.751634:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f19c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b2f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751767:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751782:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751791:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751850:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.751880:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 38 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601552.751896:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918362240:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601552.752006:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601552.755919:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601552.756088:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340224 00000100:00100000:0.0:1789601552.756105:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340224 00000100:00100000:3.0:1789601552.756154:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918362240:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601552.756161:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 39 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.756205:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601552.756205:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789601552.756224:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+39:2416:x1876532898340224:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601552.756243:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601552.756251:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 39 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756267:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 39 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756293:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f199a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b21 expref: 39 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756311:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:0.0:1789601552.756315:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756341:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756357:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601552.756391:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601552.756455:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+38:2416:x1876532898340224:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 234us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601552.756466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00010000:00010000:3.0:1789601552.756474:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.756486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601552.756513:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789601552.756771:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f19c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.756793:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.756802:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601552.756805:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601552.756821:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362800, rc 0) 00000100:00100000:3.0:1789601552.756884:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+38:11237:x1876532898340096:12345-192.168.203.48@tcp:101:dd.0 Request processed in 5427us (5707us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789601552.756893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1789601552.760980:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601552.761144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340352 00000100:00100000:2.0:1789601552.761158:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340352 00000100:00100000:2.0:1789601552.761242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:2.0:1789601552.761255:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+38:11237:x1876532898340352:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:2.0:1789601552.761288:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601552.761314:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f19d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b36 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761367:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761385:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761416:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761741:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f19d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761762:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601552.761771:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601552.761774:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789601552.761778:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:2.0:1789601552.761855:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+39:11237:x1876532898340352:12345-192.168.203.48@tcp:101:dd.0 Request processed in 603us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601552.762097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:2.0:1789601552.765410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601552.765737:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340608 00000100:00100000:3.0:1789601552.765752:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340608 00000100:00100000:3.0:1789601552.766018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:3.0:1789601552.766032:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+39:11237:x1876532898340608:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:3.0:1789601552.766378:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.766400:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.766413:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601552.766466:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789601552.766509:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003668ee4d reply state 000000005639e6ff transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.766524:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601552.766534:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601552.766537:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601552.766542:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601552.766907:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+42:11237:x1876532898340608:12345-192.168.203.48@tcp:36:dd.0 Request processed in 877us (1510us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789601552.766916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000020:00080000:3.0:1789601552.766938:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789601553.030792:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601553.057748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.058155:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340736 00000100:00100000:3.0:1789601553.058170:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340736 00000100:00100000:3.0:1789601553.058394:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789601553.058408:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+42:11251:x1876532898340736:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:3.0:1789601553.058443:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789601553.058668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789601553.058765:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f19ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b3d expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058867:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058886:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058900:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058913:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058920:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.058928:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.059023:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.059035:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.059065:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.059110:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.059125:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 43 pid: 6523 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601553.059142:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918362368:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601553.059637:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12dec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601553.063981:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918362368:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601553.064023:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.064137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.064313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898340992 00000100:00100000:3.0:1789601553.064323:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898340992 00000100:00100000:3.0:1789601553.064450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789601553.064461:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+44:6186:x1876532898340992:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789601553.064905:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+45:6186:x1876532898340992:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 444us (769us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789601553.064914:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789601553.069011:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601553.069143:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898341120 00000100:00100000:0.0:1789601553.069157:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898341120 00010000:00010000:0.0:1789601553.069339:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 45 pid: 6523 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601553.069450:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1789601553.069464:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+45:2416:x1876532898341120:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601553.069493:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601553.069502:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 45 pid: 6523 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069517:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 45 pid: 6523 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069544:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f19cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b2f expref: 45 pid: 6523 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069621:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:0.0:1789601553.069628:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069638:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069647:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.069686:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601553.069768:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+44:2416:x1876532898341120:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 307us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601553.069776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00010000:00010000:3.0:1789601553.069842:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.069851:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601553.069946:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789601553.069951:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601553.070004:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070020:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070031:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070037:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070043:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070049:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601553.070053:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070062:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070072:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601553.070075:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601553.070080:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070086:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f19f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070110:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070117:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070122:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070127:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601553.070131:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070136:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070144:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:3.0:1789601553.070146:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601553.070149:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070154:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f19fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070207:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f19ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b3d expref: 44 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070231:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b3d expref: 43 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.070250:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.070253:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601553.070255:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601553.070287:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+43:11251:x1876532898340736:12345-192.168.203.48@tcp:101:stat.0 Request processed in 11884us (12555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601553.070295:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789601553.154025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.154176:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898341376 00000100:00100000:3.0:1789601553.154190:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898341376 00000100:00100000:3.0:1789601553.154274:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1789601553.154287:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+43:11257:x1876532898341376:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:3.0:1789601553.154373:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601553.154410:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b3d expref: 43 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.154435:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.154441:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601553.154899:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.154918:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.154930:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601553.154983:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1789601553.155011:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a6b731b reply state 000000008798b715 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.155041:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.155048:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.155051:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601553.155054:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601553.155198:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+45:11257:x1876532898341376:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 912us (1187us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789601553.155208:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000020:00080000:3.0:1789601553.155214:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:0.0:1789601553.224988:0:8855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421346427673ns, next at 422346424143ns, rc = 0 00000100:00100000:2.0:1789601553.225197:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918362496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601553.225355:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601553.225541:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918362496 00000100:00100000:0.0:1789601553.225551:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918362496 00000100:00100000:0.0:1789601553.225650:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789601553.225661:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918362496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601553.225697:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789601553.225752:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918362496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601553.225772:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789601553.226945:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918362496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601553.226980:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601553.226989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918362624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601553.227042:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601553.227199:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918362624 00000100:00100000:0.0:1789601553.227206:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918362624 00000100:00100000:0.0:1789601553.227255:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789601553.227264:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918362624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601553.227306:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789601553.227368:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918362624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601553.227375:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789601553.227582:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918362624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601553.339061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.339273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898341504 00000100:00100000:2.0:1789601553.339304:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898341504 00000100:00100000:2.0:1789601553.339389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:2.0:1789601553.339403:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+45:11271:x1876532898341504:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:2.0:1789601553.339435:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.339461:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b44 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339550:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339729:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339746:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339761:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.339776:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340004:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340016:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340023:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601553.340088:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789601553.340094:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601553.340123:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340139:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340148:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340155:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340168:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.340173:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340182:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340196:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601553.340200:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.340206:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340212:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340239:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340245:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340250:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340256:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.340260:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340266:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340275:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:2.0:1789601553.340277:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.340281:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340287:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340322:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340338:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.340370:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.340373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601553.340376:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383c00, rc 0) 00000100:00100000:2.0:1789601553.340514:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+46:11271:x1876532898341504:12345-192.168.203.48@tcp:101:stat.0 Request processed in 1113us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.340523:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:1.0:1789601553.444900:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.444974:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898341760 00000100:00100000:2.0:1789601553.444988:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898341760 00000100:00100000:2.0:1789601553.445067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:2.0:1789601553.445080:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+46:11281:x1876532898341760:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601553.445107:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.445149:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b4b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601553.445298:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789601553.445452:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b4b expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.445470:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:2.0:1789601553.445474:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601553.445481:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b4b expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.445498:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601553.445653:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+47:11281:x1876532898341760:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 575us (775us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789601553.445681:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:0.0:1789601553.448832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601553.449740:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342016 00000100:00100000:1.0:1789601553.449756:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342016 00000100:00100000:1.0:1789601553.449838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789601553.449849:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+47:11281:x1876532898342016:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601553.450153:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+48:11281:x1876532898342016:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 304us (1334us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789601553.450162:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789601553.509026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.509351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342272 00000100:00100000:2.0:1789601553.509366:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342272 00000100:00100000:2.0:1789601553.509484:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1789601553.509497:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+48:11287:x1876532898342272:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601553.509531:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.509587:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b52 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.509743:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.509776:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.509786:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.511782:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.511873:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 49 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.511901:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918362752:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601553.512047:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df5020d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601553.522024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.522126:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342400 00000100:00100000:3.0:1789601553.522138:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342400 00010000:00010000:3.0:1789601553.522211:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 50 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601553.522263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789601553.522275:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+50:2415:x1876532898342400:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601553.522295:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601553.522303:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 50 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.522319:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 50 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.522356:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.522377:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.522390:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.522398:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.522424:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601553.522673:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+50:2415:x1876532898342400:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 400us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601553.522682:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00010000:00010000:2.0:1789601553.524028:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b44 expref: 49 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.524066:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918362752:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601553.524096:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.524107:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.524113:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601553.524141:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789601553.526831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.527051:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.527064:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.527068:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601553.527073:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382c00, rc 0) 00000100:00100000:2.0:1789601553.527334:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+49:11287:x1876532898342272:12345-192.168.203.48@tcp:101:bash.0 Request processed in 17836us (18320us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789601553.527354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:0.0:1789601553.532084:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.532304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342656 00000100:00100000:2.0:1789601553.532318:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342656 00000100:00100000:2.0:1789601553.532462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1789601553.532483:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+49:11287:x1876532898342656:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:2.0:1789601553.532835:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.532874:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.532898:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601553.532954:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789601553.532977:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cd2c44a reply state 000000008ad4f068 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.532993:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.533002:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.533006:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601553.533011:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601553.533128:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+52:11287:x1876532898342656:12345-192.168.203.48@tcp:36:bash.0 Request processed in 655us (1058us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789601553.533136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000020:00080000:2.0:1789601553.533142:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789601553.537410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.537718:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342784 00000100:00100000:3.0:1789601553.537734:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342784 00000100:00100000:2.0:1789601553.538468:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789601553.538486:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+52:11287:x1876532898342784:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601553.538525:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.540585:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b59 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.542505:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.542544:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.542584:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.544432:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.544469:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 53 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.544490:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918362880:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601553.545015:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d103a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601553.551679:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918362880:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601553.551724:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601553.556061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.556444:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898342912 00000100:00100000:2.0:1789601553.557375:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898342912 00010000:00010000:2.0:1789601553.557714:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 54 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601553.557815:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789601553.557832:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+54:2416:x1876532898342912:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601553.557851:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601553.557868:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 54 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.557894:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 54 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.557927:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b52 expref: 54 pid: 6521 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.557947:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:0.0:1789601553.557953:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.557965:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.557975:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601553.558027:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601553.558129:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.558140:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601553.558160:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+53:2416:x1876532898342912:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 333us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601553.558169:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000004:00200000:2.0:1789601553.558220:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789601553.558226:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601553.558252:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.558289:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b59 expref: 53 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.559117:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b59 expref: 52 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.559127:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.559130:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601553.559132:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601553.559214:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+52:11287:x1876532898342784:12345-192.168.203.48@tcp:101:bash.0 Request processed in 20733us (21821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.559223:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1789601553.571759:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.577761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898343168 00000100:00100000:2.0:1789601553.577787:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898343168 00000100:00100000:0.0:1789601553.579703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789601553.579720:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0981850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+52:11287:x1876532898343168:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1789601553.580424:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0981850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+53:11287:x1876532898343168:12345-192.168.203.48@tcp:35:bash.0 Request processed in 706us (8678us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789601553.580434:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789601553.654726:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.654801:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898343424 00000100:00100000:3.0:1789601553.654816:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898343424 00000100:00100000:3.0:1789601553.655031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:3.0:1789601553.655047:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+53:11297:x1876532898343424:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601553.655080:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601553.655108:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b60 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601553.655257:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789601553.655406:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b60 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.655424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601553.655428:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601553.655454:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1a65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b60 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.655734:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601553.655809:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+54:11297:x1876532898343424:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 766us (1099us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1789601553.655817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:1.0:1789601553.661064:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.661297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898343552 00000100:00100000:2.0:1789601553.661311:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898343552 00000100:00100000:2.0:1789601553.661406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1789601553.661419:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+54:11297:x1876532898343552:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789601553.661533:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661581:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661620:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661641:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661648:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661742:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661751:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661769:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601553.661842:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661858:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661865:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661872:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661899:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.661905:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661914:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661929:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601553.661932:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.661938:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661944:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661959:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661965:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661971:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661976:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.661979:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.661984:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662001:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:2.0:1789601553.662004:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.662013:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662020:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662031:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662037:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662042:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662047:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.662050:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662056:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662064:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.662066:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.662069:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.662075:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.662198:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+54:11297:x1876532898343552:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 781us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.662208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:1.0:1789601553.667854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.668260:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898343808 00000100:00100000:3.0:1789601553.668273:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898343808 00000100:00100000:3.0:1789601553.668358:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789601553.668370:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+54:11297:x1876532898343808:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601553.672356:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+55:11297:x1876532898343808:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 3964us (4494us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789601553.672376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1789601553.726700:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.726859:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344064 00000100:00100000:2.0:1789601553.726890:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344064 00000100:00100000:2.0:1789601553.726976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1789601553.726989:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+55:11300:x1876532898344064:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601553.727026:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.727054:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b67 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727199:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727214:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727222:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727228:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727420:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1a9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727430:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727438:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601553.727450:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789601553.727844:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727854:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727862:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727868:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.727873:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727938:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727954:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601553.727958:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.727964:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727981:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1a8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.727998:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728004:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728010:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728015:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.728019:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728025:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728032:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:2.0:1789601553.728035:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601553.728038:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728044:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1a96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728091:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1a88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b67 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728106:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b67 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.728120:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.728123:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601553.728126:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030c00, rc 0) 00000100:00100000:2.0:1789601553.728366:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+57:11300:x1876532898344064:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1379us (1679us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789601553.728376:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:1.0:1789601553.734187:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601553.734256:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.734375:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344192 00000100:00100000:2.0:1789601553.734390:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344192 00000100:00100000:2.0:1789601553.734473:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1789601553.734485:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+57:11300:x1876532898344192:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789601553.734609:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734631:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734647:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734695:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734703:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734711:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734718:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601553.734737:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734747:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734762:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.734767:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601553.734773:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.734780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1aab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601553.734878:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+57:11300:x1876532898344192:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 396us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.735002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1789601553.736014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344320 00000100:00100000:3.0:1789601553.736024:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344320 00000100:00100000:3.0:1789601553.736088:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789601553.736099:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+57:2416:x1876532898344320:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601553.736114:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601553.736137:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1a9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b67 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.736157:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.736161:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601553.736225:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+56:2416:x1876532898344320:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 128us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601553.736232:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789601553.740851:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601553.741088:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344576 00000100:00100000:0.0:1789601553.741101:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344576 00000100:00100000:0.0:1789601553.741319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789601553.741333:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+56:11300:x1876532898344576:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601553.741693:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+57:11300:x1876532898344576:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 362us (855us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789601553.748623:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789601553.885743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601553.885897:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344832 00000100:00100000:3.0:1789601553.885909:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344832 00000100:00100000:3.0:1789601553.885979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1789601553.886123:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+57:11318:x1876532898344832:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1789601553.886166:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601553.886193:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1ab2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b6e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.886370:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ab9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.886390:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.886408:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601553.886420:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789601553.886621:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1ab2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b6e expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.886645:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b6e expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601553.886654:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601553.886658:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789601553.886662:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528800, rc 0) 00000100:00100000:3.0:1789601553.886742:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+59:11318:x1876532898344832:12345-192.168.203.48@tcp:101:cat.0 Request processed in 754us (1012us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789601553.886771:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:1.0:1789601553.923265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.923415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898344960 00000100:00100000:2.0:1789601553.923435:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898344960 00000100:00100000:2.0:1789601553.923988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:2.0:1789601553.924002:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+59:11319:x1876532898344960:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601553.924038:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601553.924066:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924172:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924213:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601553.924278:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789601553.924284:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601553.924310:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924356:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b75 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924381:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b75 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.924392:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601553.924395:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601553.924400:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031a00, rc 0) 00000100:00100000:2.0:1789601553.924497:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+60:11319:x1876532898344960:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 498us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.924505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:3.0:1789601553.933161:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601553.933351:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345344 00000100:00100000:0.0:1789601553.933366:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345344 00000100:00100000:0.0:1789601553.933439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789601553.933451:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+60:11319:x1876532898345344:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601553.934158:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:11319:x1876532898345344:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 704us (1008us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789601553.934186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789601553.940614:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.941053:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345472 00000100:00100000:2.0:1789601553.941066:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345472 00000100:00100000:2.0:1789601553.941145:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789601553.941157:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:11319:x1876532898345472:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:2.0:1789601553.941179:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789601553.941281:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1a5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b59 expref: 61 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.941332:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ab9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b6e expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.941360:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f195b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b13 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.941374:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601553.941381:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601553.941465:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+58:11319:x1876532898345472:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 311us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.941473:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789601553.946432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601553.946680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345600 00000100:00100000:2.0:1789601553.946696:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345600 00000100:00100000:2.0:1789601553.946947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1789601553.946963:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+58:11319:x1876532898345600:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789601553.947154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.947177:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601553.947192:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601553.949283:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601553.950517:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789601553.950933:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789601553.954701:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+58:11319:x1876532898345600:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 7727us (8267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601553.954720:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:3.0:1789601554.020709:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.020818:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345728 00000100:00100000:1.0:1789601554.020831:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345728 00000100:00100000:3.0:1789601554.021046:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:3.0:1789601554.021061:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+58:11321:x1876532898345728:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601554.021089:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601554.021115:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1adc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b7c expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021204:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021222:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021236:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021253:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021262:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021269:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021388:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021399:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021407:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601554.021875:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789601554.021881:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601554.021905:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021920:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021930:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021937:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021945:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021952:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.021957:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021967:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.021989:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:3.0:1789601554.021991:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601554.021997:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022002:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1ae3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022015:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022018:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022022:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022025:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.022027:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022030:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022034:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:3.0:1789601554.022035:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601554.022037:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022040:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1aea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022075:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1adc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 60 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022088:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 59 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.022093:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.022095:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601554.022096:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7363e00, rc 0) 00000100:00100000:3.0:1789601554.022159:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+59:11321:x1876532898345728:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1103us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.022164:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00010000:00010000:0.0:1789601554.054830:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601554.212603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.212648:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.212669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.212703:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345984 00000100:00100000:2.0:1789601554.212712:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345984 00000100:00080000:2.0:1789601554.212740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601554.212791:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346240 00000100:00100000:2.0:1789601554.212795:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346240 00000100:00080000:2.0:1789601554.212809:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601554.212821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 307 00000100:00100000:2.0:1789601554.212832:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898345984:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601554.212897:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898345984:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.212905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 307 00000100:00100000:2.0:1789601554.212939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 308 00000100:00100000:2.0:1789601554.212945:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898346240:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601554.212969:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898346240:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.212974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 308 00000100:00100000:3.0:1789601554.213351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898345856 00000100:00100000:3.0:1789601554.213357:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898345856 00000100:00100000:3.0:1789601554.213394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 386 00000100:00100000:3.0:1789601554.213402:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898345856:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601554.213444:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898345856:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.213450:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 386 00000100:00100000:2.0:1789601554.219001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.219041:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.219616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346368 00000100:00100000:0.0:1789601554.219626:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346368 00000100:00100000:0.0:1789601554.219704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 309 00000100:00100000:0.0:1789601554.219713:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898346368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601554.219783:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2418:x1876532898346368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 63us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.219791:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 309 00000100:00100000:3.0:1789601554.220099:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346112 00000100:00100000:3.0:1789601554.220104:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346112 00000100:00100000:3.0:1789601554.220154:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:3.0:1789601554.220162:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2418:x1876532898346112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601554.220192:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2418:x1876532898346112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.220217:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00080000:2.0:1789601554.220379:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601554.220384:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1789601554.373814:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601554.373825:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601554.373864:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789601554.373874:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601554.374009:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918363008:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601554.374122:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c29a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601554.393631:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918363008:192.168.203.48@tcp:107:hsm_cdtr.0 00000001:00080000:1.0:1789601554.404542:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:1.0:1789601554.404599:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1789601554.405860:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789601554.408737:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408775:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408783:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408790:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.408795:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408803:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408820:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df4e0d94c00) 00010000:00010000:2.0:1789601554.408824:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.408830:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408835:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1897 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408870:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408877:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408882:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408886:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.408895:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408901:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408910:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601554.408913:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.408915:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408920:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f189e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408936:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408942:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408948:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408952:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.408955:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408960:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408968:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df501e4ff00) 00010000:00010000:2.0:1789601554.408970:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.408979:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.408985:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f18dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409001:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409007:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409013:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409018:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.409020:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409026:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409035:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601554.409037:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.409040:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409046:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f19e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409055:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409061:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409072:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409077:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.409079:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409085:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409092:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601554.409095:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.409097:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409612:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1a0a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409625:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409632:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409639:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409644:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.409647:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409664:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409673:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:2.0:1789601554.409675:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601554.409678:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.409683:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1a50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.410079:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601554.410113:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918363136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789601554.410180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601554.410595:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918363136 00000100:00100000:3.0:1789601554.410603:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918363136 00000100:00100000:3.0:1789601554.410657:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789601554.410667:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876532918363136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789601554.410692:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789601554.410723:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aab270f, atime: 0x6aab270f, ctime: 0x6aab270f, blocks: 0x8 00010000:00010000:3.0:1789601554.410730:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.410755:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1789601554.410760:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601554.410765:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.410781:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.410790:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.410807:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.410824:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601554.410964:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876532918363136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 298us (784us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789601554.410970:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789601554.410994:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601554.410999:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.411006:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601554.411010:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.411018:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.411032:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.411039:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000668dc614/0x74872e3eca9f1af8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.411054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601554.411061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601554.411062:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789601554.411090:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4d0158380/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789601554.411096:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918363136:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789601554.411814:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601554.411957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.412064:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346496 00000100:00100000:3.0:1789601554.412070:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346496 00000100:00100000:3.0:1789601554.412124:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789601554.412132:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+28:11332:x1876532898346496:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601554.412157:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601554.412494:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+28:11332:x1876532898346496:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 362us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.412501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000020:00080000:1.0:1789601554.413001:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4d12de6c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789601554.413006:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7330c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4d12dee40 00000020:00080000:1.0:1789601554.413009:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4d944e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c2ae3800 00000020:00080000:2.0:1789601554.413091:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789601554.413278:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789601554.418094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.418245:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346624 00000100:00100000:0.0:1789601554.418255:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346624 00000100:00100000:0.0:1789601554.418317:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789601554.418329:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+12:11332:x1876532898346624:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789601554.418412:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418441:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418504:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418528:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418537:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418603:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601554.418670:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789601554.418675:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601554.418693:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418705:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418712:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.418719:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419021:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601554.419027:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419043:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:0.0:1789601554.419060:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601554.419065:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1aff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419085:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419091:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419097:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601554.419261:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419268:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419277:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8df501e4fe00) 00010000:00010000:0.0:1789601554.419280:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601554.419283:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419298:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419314:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419320:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419326:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419331:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601554.419334:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419350:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419358:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:0.0:1789601554.419361:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601554.419364:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.419369:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.419497:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+12:11332:x1876532898346624:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1167us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.419505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789601554.425830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.425988:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898346880 00000100:00100000:3.0:1789601554.426005:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898346880 00000100:00100000:3.0:1789601554.426092:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:3.0:1789601554.426106:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+12:11332:x1876532898346880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601554.426143:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601554.426170:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1b14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b83 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426324:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426354:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426369:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601554.426404:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789601554.426516:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426525:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426533:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426539:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.426545:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426608:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426626:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.426630:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601554.426637:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426645:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1b1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426699:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1b14 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b83 expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426711:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:3.0:1789601554.426715:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601554.426727:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1b14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b83 expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.426741:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362800, rc 0) 00000100:00100000:3.0:1789601554.426827:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898346880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 724us (1005us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1789601554.426836:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:3.0:1789601554.444645:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.444889:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898347008 00000100:00100000:2.0:1789601554.444898:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898347008 00000100:00100000:2.0:1789601554.444956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:2.0:1789601554.444965:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898347008:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601554.444998:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601554.445141:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898347008:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 176us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.445149:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:3.0:1789601554.459261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.459503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898347264 00000100:00100000:0.0:1789601554.459514:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898347264 00000100:00100000:0.0:1789601554.459599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:0.0:1789601554.459610:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898347264:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601554.459630:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601554.459633:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789601554.459657:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ace lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b75 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.459677:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601554.459682:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601554.459696:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b8a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601554.462036:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789601554.462193:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.462962:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.462978:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.463053:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1b29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b8a expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.463072:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b8a expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.463091:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df501e4fe00) 00010000:00010000:0.0:1789601554.463094:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601554.463097:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601554.463169:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898347264:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 3560us (3916us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789601554.463178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:2.0:1789601554.484719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.487228:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898347520 00000100:00100000:1.0:1789601554.487244:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898347520 00000100:00100000:1.0:1789601554.487347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:1.0:1789601554.487358:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898347520:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.487413:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601554.488166:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1b30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b8a expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.488189:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df501e4fe00) 00010000:00010000:1.0:1789601554.488199:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601554.488232:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490319:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490349:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490413:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490528:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490536:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490666:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490674:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490681:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490687:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601554.490707:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490714:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490726:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601554.490729:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601554.490734:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490740:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1b3e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490755:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490761:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490766:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490771:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601554.490774:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490779:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490786:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x2a212b6c (ffff8df4f73ddf00) 00010000:00010000:1.0:1789601554.490788:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601554.490796:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.490803:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2a212b6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601554.490953:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898347520:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 3593us (6245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601554.490962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:3.0:1789601554.510681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.511605:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898347648 00000100:00100000:1.0:1789601554.511621:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898347648 00000100:00100000:1.0:1789601554.511692:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1789601554.511704:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+13:11332:x1876532898347648:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.511730:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601554.511757:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b91 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.511803:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.511819:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.511834:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.511986:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.512007:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.512024:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.512027:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601554.512032:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601554.512109:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898347648:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 407us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601554.512117:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1789601554.521756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.521904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898347904 00000100:00100000:1.0:1789601554.521918:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898347904 00000100:00100000:1.0:1789601554.521994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:1.0:1789601554.522009:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898347904:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.522128:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.522151:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.522167:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601554.522414:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789601554.522427:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422643869605ns, next at 423643866535ns, rc = 0 00000004:00010000:1.0:1789601554.522486:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000049235b4 reply state 00000000ac68d278 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.522499:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.522507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.522519:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789601554.522525:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601554.522677:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11332:x1876532898347904:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 671us (937us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789601554.522684:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:2.0:1789601554.530286:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.530347:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348032 00000100:00100000:2.0:1789601554.530360:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348032 00000100:00100000:2.0:1789601554.530435:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:2.0:1789601554.530456:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:11332:x1876532898348032:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601554.530489:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601554.530514:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b98 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.530617:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.530637:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.530661:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:2.0:1789601554.530664:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601554.530669:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031c00, rc 0) 00000100:00100000:2.0:1789601554.530743:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+17:11332:x1876532898348032:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 289us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.530751:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:2.0:1789601554.538284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.538373:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348160 00000100:00100000:0.0:1789601554.538387:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348160 00000100:00100000:0.0:1789601554.538445:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789601554.538458:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2414:x1876532898348160:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789601554.538504:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1789601554.538544:0:8439:0:(genops.c:1384:class_connect()) connect: client af09a131-8cce-462c-8c01-5d48daa688cf, cookie 0x74872e3eca9f1b68 00002000:00100000:0.0:1789601554.538647:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af09a131-8cce-462c-8c01-5d48daa688cf/ffff8df3c4009800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601554.538670:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601554.538773:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601554.538812:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c400a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601554.538903:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2414:x1876532898348160:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 Request processed in 445us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.538912:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:2.0:1789601554.547473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.549154:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348288 00000100:00100000:1.0:1789601554.549172:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348288 00000100:00100000:1.0:1789601554.549268:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:1.0:1789601554.549282:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:0:x1876532898348288:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789601554.549288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789601554.552106:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1789601554.552176:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000100:00100000:3.0:1789601554.552392:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:0:x1876532898348288:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 3106us (4924us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789601554.552405:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:2.0:1789601554.567531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.570632:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348544 00000100:00100000:1.0:1789601554.570652:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348544 00000100:00100000:0.0:1789601554.570823:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:0.0:1789601554.570842:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+17:11332:x1876532898348544:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601554.572635:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+18:11332:x1876532898348544:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1788us (5106us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789601554.573442:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601554.586166:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.597130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348800 00000100:00100000:0.0:1789601554.597151:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348800 00000100:00100000:0.0:1789601554.597235:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:0.0:1789601554.597249:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:11332:x1876532898348800:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789601554.597750:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:11332:x1876532898348800:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 502us (11597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.597759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:3.0:1789601554.608142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.608299:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898348928 00000100:00100000:1.0:1789601554.608313:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898348928 00000100:00100000:1.0:1789601554.608404:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1789601554.608417:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+18:11332:x1876532898348928:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.608446:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601554.608474:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48b9f expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608599:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608618:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608633:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601554.608709:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601554.608748:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608780:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b9f expref: 20 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608800:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b9f expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.608810:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.608813:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789601554.608818:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef600, rc 0) 00000100:00100000:1.0:1789601554.608901:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:11332:x1876532898348928:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 486us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601554.608909:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1789601554.612493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.612669:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349056 00000100:00100000:1.0:1789601554.612682:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349056 00000100:00100000:1.0:1789601554.612759:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1789601554.612772:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898349056:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.612796:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601554.612822:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ba6 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601554.612856:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab2712, blocks: 0x0 00010000:00010000:1.0:1789601554.612884:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789601554.612904:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601554.612915:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.612940:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.612957:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efc00, rc 0) 00000100:00100000:1.0:1789601554.613023:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898349056:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 253us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601554.613031:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789601554.619860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.620500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349312 00000100:00100000:1.0:1789601554.620514:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349312 00000100:00100000:1.0:1789601554.620611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:1.0:1789601554.620625:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:11332:x1876532898349312:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789601554.620778:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:11332:x1876532898349312:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 156us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601554.620788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:0.0:1789601554.627356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.632679:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349440 00000100:00100000:3.0:1789601554.632702:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349440 00000100:00100000:3.0:1789601554.632806:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789601554.632820:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:11332:x1876532898349440:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601554.632848:0:8857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601554.632875:0:8857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bad expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.632920:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.632951:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601554.632956:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601554.632963:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 7 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.633013:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.633029:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 7 pid: 8441 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.633046:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918363264:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601554.633191:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601554.642731:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.642916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349568 00000100:00100000:1.0:1789601554.642929:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349568 00010000:00010000:1.0:1789601554.642990:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 8 pid: 8441 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601554.643036:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:1.0:1789601554.643048:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898349568:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601554.643068:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601554.643106:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 8 pid: 8441 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.643123:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 8 pid: 8441 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.643156:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601554.643162:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601554.643172:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.643186:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.643236:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601554.643254:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1876532918363392:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789601554.643363:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9bb43c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789601554.646053:0:8857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f1b7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ba6 expref: 8 pid: 8441 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.646080:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918363264:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601554.646119:0:8857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 7 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.646139:0:8857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7362800, rc 0) 00000100:00100000:3.0:1789601554.647470:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:11332:x1876532898349440:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 14550us (20035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.647499:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789601554.652388:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1876532918363392:192.168.203.48@tcp:105: 00010000:00010000:0.0:1789601554.652428:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601554.652501:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898349568:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 9454us (10134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.652515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1789601554.653362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.653944:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349696 00000100:00100000:2.0:1789601554.653955:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349696 00002000:00100000:2.0:1789601554.654021:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8df4ff502a00 x1876532898349696/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:150/0 lens 504/0 e 0 to 0 dl 1789601565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601554.654033:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4ff502a00 with x1876532898349696 ext(0->8) 00002000:00010000:2.0:1789601554.654052:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df4ff502a00 00000100:00100000:2.0:1789601554.654083:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789601554.654093:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898349696:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601554.656756:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898349696:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 2649us (3381us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789601554.656775:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:2.0:1789601554.656792:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8df4ff502a00 x1876532898349696/t4294967303(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:150/0 lens 504/448 e 0 to 0 dl 1789601565 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601554.656803:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4ff502a00 with x1876532898349696 ext(0->8) 00002000:00010000:2.0:1789601554.656812:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df4ff502a00 00000100:00100000:0.0:1789601554.660094:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.660186:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349824 00000100:00100000:3.0:1789601554.660199:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349824 00000100:00100000:3.0:1789601554.660265:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:3.0:1789601554.660277:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:11332:x1876532898349824:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789601554.669857:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1789601554.669879:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789601554.669901:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1789601554.670099:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670113:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670131:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670138:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601554.670144:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670153:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670186:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:2.0:1789601554.670190:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601554.670207:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.670214:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1b5a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789601554.670244:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789601554.670259:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789601554.670269:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601554.670291:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918363520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789601554.670400:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601554.670888:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898349824:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 10609us (10800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.670900:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:1.0:1789601554.671889:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918363520 00000100:00100000:1.0:1789601554.671904:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918363520 00000100:00100000:1.0:1789601554.671977:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601554.671988:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918363520:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789601554.672151:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789601554.673626:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789601554.673640:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789601554 00002000:00010000:1.0:1789601554.673643:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789601554.673646:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789601554 -> 1789601554 00002000:00010000:1.0:1789601554.673649:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789601554.673739:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918363520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1751us (3337us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789601554.673749:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789601554.674131:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4e0f8f480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789601554.674141:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918363520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789601554.676657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.676812:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898349952 00000100:00100000:1.0:1789601554.676917:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898349952 00000100:00100000:1.0:1789601554.676991:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789601554.677499:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f776fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898349952:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789601554.683294:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789601554.683314:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789601554.683603:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f776fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898349952:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 6102us (6952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.683616:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:3.0:1789601554.691487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.693963:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350208 00000100:00100000:1.0:1789601554.693988:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350208 00000100:00100000:1.0:1789601554.694196:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1789601554.694211:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898350208:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601554.694289:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601554.694328:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1b76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b9f expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.694359:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.694366:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601554.694416:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.694434:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.694446:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601554.694650:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c36c7b6e reply state 000000005997b86b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.694665:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.694673:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.694675:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601554.694678:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601554.694814:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+15:11332:x1876532898350208:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 605us (3339us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789601554.694822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:0.0:1789601554.698246:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.698359:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350336 00000100:00100000:3.0:1789601554.698437:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350336 00000100:00100000:3.0:1789601554.698501:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789601554.698515:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898350336:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789601554.699089:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789601554.699094:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789601554 -> 1789601553 00002000:00010000:3.0:1789601554.699097:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789601551 00002000:00010000:3.0:1789601554.699099:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789601554 -> 1789601553 00002000:00010000:3.0:1789601554.699101:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789601554.699448:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898350336:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 933us (1209us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789601554.699457:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789601554.708106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.708305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350592 00000100:00100000:0.0:1789601554.708318:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350592 00000100:00100000:0.0:1789601554.708405:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:0.0:1789601554.708420:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+15:11332:x1876532898350592:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789601554.708548:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.708594:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.708624:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.708668:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.708685:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 15 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.708701:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918363648:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601554.708935:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c17b4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601554.712415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601554.712545:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918363648:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601554.712615:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.712848:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350720 00000100:00100000:3.0:1789601554.712857:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350720 00010000:00010000:3.0:1789601554.712995:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 16 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.713042:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789601554.713053:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:2415:x1876532898350720:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601554.713075:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601554.713083:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 16 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713097:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 16 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713124:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b91 expref: 16 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713142:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:3.0:1789601554.713148:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713159:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713168:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.713232:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601554.713295:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+15:2415:x1876532898350720:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 244us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.713304:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00010000:00010000:1.0:1789601554.725111:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725135:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725193:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725202:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725211:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725217:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601554.725223:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725257:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725280:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601554.725283:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789601554.725290:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.725297:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1b92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601554.725449:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898350592:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 17025us (17347us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789601554.725471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:1.0:1789601554.730140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.730474:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350848 00000100:00100000:3.0:1789601554.730489:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350848 00000100:00100000:3.0:1789601554.730585:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1789601554.730600:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898350848:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789601554.730660:0:8857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.730686:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 7 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.730696:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601554.730702:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601554.730707:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.730753:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 7 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.730772:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 7 pid: 8857 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.730791:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918363776:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601554.731268:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601554.745841:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918363776:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601554.745841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:2.0:1789601554.745884:0:8857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.745893:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898350976 00000100:00100000:0.0:1789601554.745905:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898350976 00010000:00010000:0.0:1789601554.745958:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.746003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1789601554.746016:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898350976:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601554.746033:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601554.746061:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.746092:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.746121:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000668dc614/0x74872e3eca9f1b84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bad expref: 8 pid: 8857 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.746142:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601554.746149:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601554.746155:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.746166:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601554.746202:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601554.746234:0:8857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746248:0:8857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601554.746265:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898350976:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 250us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.746275:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00010000:00010000:2.0:1789601554.746282:0:8857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746293:0:8857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746303:0:8857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746311:0:8857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601554.746316:0:8857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746326:0:8857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746351:0:8857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.746359:0:8857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002af1d5ee/0x74872e3eca9f1b99 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601554.746415:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898350848:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 15819us (16288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.746424:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:0.0:1789601554.750690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.750947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898351232 00000100:00100000:2.0:1789601554.750962:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898351232 00000100:00100000:2.0:1789601554.751049:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:2.0:1789601554.751117:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+14:11332:x1876532898351232:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789601554.751226:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.751246:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.751256:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.751300:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.751316:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 14 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601554.751332:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918363904:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601554.751448:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d103a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601554.758079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918364032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601554.758774:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601554.758833:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601554.758877:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918364032 00000100:00100000:0.0:1789601554.758895:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918364032 00000100:00100000:0.0:1789601554.758976:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601554.758988:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918364032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789601554.759020:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1789601554.765446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601554.765548:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918363904:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601554.765601:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789601554.769905:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601554.770093:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898351360 00000100:00100000:1.0:1789601554.770107:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898351360 00000100:00100000:2.0:1789601554.771625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601554.771690:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 15 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601554.772016:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1789601554.772035:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+15:2416:x1876532898351360:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601554.772075:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601554.772087:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 15 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772104:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 15 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772131:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f19e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b36 expref: 15 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772151:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:1.0:1789601554.772157:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772169:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772319:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601554.772369:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601554.772438:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:2416:x1876532898351360:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 410us (7006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601554.772447:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00010000:00010000:2.0:1789601554.772611:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.772623:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.773045:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.773064:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.773074:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.773115:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.773134:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601554.773151:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918364288:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601554.773224:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d103a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601554.775210:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918364032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16212us (16424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.775244:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601554.775280:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918364160 00000100:00100000:0.0:1789601554.775289:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918364160 00000100:00100000:0.0:1789601554.775328:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789601554.775348:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918364160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601554.775378:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789601554.775431:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918364160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601554.775438:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789601554.776415:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789601554.776425:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4e0f8f480, transno 4294967304 00000100:00100000:2.0:1789601554.776469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601554.777362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918364032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601554.779073:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601554.779795:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898351488 00000100:00100000:2.0:1789601554.779806:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898351488 00010000:00010000:2.0:1789601554.779866:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601554.779921:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789601554.779934:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:2415:x1876532898351488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601554.779969:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601554.779978:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.779994:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 15 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780025:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:2.0:1789601554.780032:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780044:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780053:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780080:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601554.780153:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:2415:x1876532898351488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 222us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601554.780163:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00010000:00010000:2.0:1789601554.780222:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1b61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b98 expref: 14 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601554.780240:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918364288:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601554.780268:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780279:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601554.780295:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601554.780460:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789601554.780632:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789601554.780676:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789601554.780779:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918364416:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789601554.780843:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601554.780878:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d103a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601554.781187:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918364416 00000100:00100000:3.0:1789601554.781194:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918364416 00000100:00100000:3.0:1789601554.781245:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789601554.781254:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918364416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789601554.781365:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918364416:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.781373:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789601554.781414:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918364416:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789601554.781850:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789601554.781911:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918364544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789601554.781971:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601554.781995:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601554.783320:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918364544 00000100:00100000:2.0:1789601554.783343:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918364544 00000100:00100000:2.0:1789601554.783398:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789601554.783410:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918364544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789601554.783735:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876532918364544:12345-0@lo:1000:mdt00_000.0 Request processed in 328us (1762us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789601554.783743:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789601554.786272:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918364544:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789601554.786371:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786385:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786394:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786401:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.786407:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786419:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786455:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:3.0:1789601554.786596:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601554.786604:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786612:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1ba7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786653:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786659:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786665:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786727:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.786731:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786822:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786832:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.786834:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601554.786838:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786844:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1ad5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786940:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786960:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.786970:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.787017:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.787035:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 17 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.787051:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918364672:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601554.787165:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601554.797645:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.797689:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898351616 00000100:00100000:3.0:1789601554.797701:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898351616 00010000:00010000:3.0:1789601554.797759:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 18 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.797809:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1789601554.797820:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+18:2416:x1876532898351616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601554.797838:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601554.797846:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 18 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.797873:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 18 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.797903:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.797909:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.797922:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.797931:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.797957:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601554.798040:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+18:2416:x1876532898351616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 221us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601554.798049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:3.0:1789601554.798238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1af1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48b7c expref: 17 pid: 9040 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601554.798255:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918364672:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601554.798283:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798293:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798300:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798398:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798407:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798415:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798421:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.798427:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798437:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798447:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.798450:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601554.798454:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798460:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1bae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798473:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798480:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798486:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798499:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601554.798502:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798508:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798517:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8955500) 00010000:00010000:3.0:1789601554.798519:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601554.798522:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.798529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1ba0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601554.798796:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601554.798802:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601554.798822:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789601554.798828:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601554.798917:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11332:x1876532898351232:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 47804us (48467us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789601554.798927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000020:00080000:3.0:1789601554.798932:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789601554.808989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601554.809194:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898351872 00000100:00100000:3.0:1789601554.809207:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898351872 00000100:00100000:3.0:1789601554.809307:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:3.0:1789601554.809319:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11332:x1876532898351872:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789601554.809813:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789601554.809888:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789601554.809955:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.809971:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.809983:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.809992:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.809998:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.810005:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.810032:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601554.811595:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:11332:x1876532898351872:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 2270us (2615us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789601554.811608:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000020:00080000:3.0:1789601554.811614:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789601554.811654:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601554.811662:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.811671:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601554.811675:0:7464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.811699:0:7464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.811712:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:3.0:1789601554.811715:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789601554.811721:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.811727:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1bb5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601554.811742:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601554.811743:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601554.811745:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601555.077768:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601555.171625:0:14214:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601555.171635:0:14214:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601555.171762:0:14214:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789601555.171769:0:14214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601555.361149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.361318:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898352128 00000100:00100000:2.0:1789601555.361343:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898352128 00000100:00100000:2.0:1789601555.361465:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:2.0:1789601555.361478:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+18:11342:x1876532898352128:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601555.361513:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.361539:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1bbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bb4 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.361722:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1bc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.361740:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.361784:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601555.361800:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789601555.361964:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1bbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bb4 expref: 21 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.361994:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bb4 expref: 20 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.362004:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.362009:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601555.362013:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031a00, rc 0) 00000100:00100000:2.0:1789601555.362095:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+20:11342:x1876532898352128:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 620us (965us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789601555.362104:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00080000:3.0:1789601555.362205:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601555.366230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601555.366305:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898352256 00000100:00100000:1.0:1789601555.366315:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898352256 00000100:00100000:1.0:1789601555.366379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:1.0:1789601555.366394:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:11342:x1876532898352256:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1789601555.366472:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366491:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366503:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366526:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366533:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366636:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366644:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366651:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601555.366698:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366729:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366735:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366752:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366758:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601555.366762:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366769:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366789:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601555.366792:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601555.366797:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366804:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1bd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366817:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366824:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366829:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366842:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601555.366845:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366852:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366862:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df4f8af9e00) 00010000:00010000:1.0:1789601555.366865:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601555.366868:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366874:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1bd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366891:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366898:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366904:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366910:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601555.366913:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366919:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366940:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:1.0:1789601555.366942:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601555.366946:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.366952:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1bdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601555.367042:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:11342:x1876532898352256:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 653us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601555.367051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:2.0:1789601555.434948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.435020:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898352512 00000100:00100000:2.0:1789601555.435035:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898352512 00000100:00100000:2.0:1789601555.435112:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:2.0:1789601555.435126:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+20:11345:x1876532898352512:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601555.435156:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.435187:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1be6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bbb expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435287:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435326:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435354:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435373:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435381:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435389:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435547:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435586:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435595:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601555.435609:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789601555.435712:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435721:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435727:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435740:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.435746:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435756:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435771:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.435775:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.435782:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435790:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1bed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435804:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435810:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435816:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435822:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.435825:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435831:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435849:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cd00) 00010000:00010000:2.0:1789601555.435852:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.435855:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435862:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1bf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435917:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1be6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 23 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435935:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 22 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.435943:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.435945:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601555.435948:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030c00, rc 0) 00000100:00100000:2.0:1789601555.436030:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+22:11345:x1876532898352512:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 907us (1099us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789601555.436039:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:3.0:1789601555.440989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.441030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898352640 00000100:00100000:3.0:1789601555.441044:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898352640 00000100:00100000:3.0:1789601555.441114:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:3.0:1789601555.441129:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+22:11345:x1876532898352640:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789601555.441222:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.441244:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.441260:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.441322:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450390:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450413:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450420:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601555.450427:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450438:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450458:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.450461:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601555.450467:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.450474:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601555.450639:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+22:11345:x1876532898352640:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 9507us (9655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601555.450651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:3.0:1789601555.458947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601555.467475:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898352896 00000100:00100000:0.0:1789601555.467500:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898352896 00000100:00100000:0.0:1789601555.467607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1789601555.467621:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0981c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+22:11345:x1876532898352896:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601555.467934:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0981c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+23:11345:x1876532898352896:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 315us (9001us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789601555.467942:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1789601555.537204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.537290:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353152 00000100:00100000:2.0:1789601555.537304:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353152 00000100:00100000:2.0:1789601555.537386:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:2.0:1789601555.537399:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+23:10871:x1876532898353152:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601555.537429:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.537454:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1c10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bc2 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.537652:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.537672:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.537682:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.537725:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.537742:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 24 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601555.537760:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918364800:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601555.537881:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601555.540883:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918364800:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601555.540925:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601555.541839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.541927:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353280 00000100:00100000:3.0:1789601555.541937:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353280 00010000:00010000:3.0:1789601555.542007:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 25 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601555.542052:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:3.0:1789601555.542064:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+25:2415:x1876532898353280:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601555.542082:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601555.542090:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 25 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542105:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 25 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542131:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1bfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bbb expref: 25 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542151:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.542157:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542168:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542178:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.542287:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601555.542366:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+24:2415:x1876532898353280:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 303us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601555.542374:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:0.0:1789601555.542934:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.542946:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601555.542981:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789601555.543152:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f1c10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 25 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.543173:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.543183:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:0.0:1789601555.543186:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601555.543189:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030600, rc 0) 00000100:00100000:0.0:1789601555.543240:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+24:10871:x1876532898353152:12345-192.168.203.48@tcp:101:bash.0 Request processed in 5845us (6051us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789601555.543248:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:0.0:1789601555.546291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.546394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353408 00000100:00100000:3.0:1789601555.546407:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353408 00000100:00100000:3.0:1789601555.546479:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:3.0:1789601555.546492:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:10871:x1876532898353408:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601555.546535:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601555.546597:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bc9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546641:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1c2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546659:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546673:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546823:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc9 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546858:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1c2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc9 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.546870:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.546874:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601555.546879:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528400, rc 0) 00000100:00100000:3.0:1789601555.546955:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+25:10871:x1876532898353408:12345-192.168.203.48@tcp:101:bash.0 Request processed in 465us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601555.546964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:3.0:1789601555.551232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601555.551613:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353664 00000100:00100000:0.0:1789601555.551626:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353664 00000100:00100000:0.0:1789601555.551705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:0.0:1789601555.551718:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+25:10871:x1876532898353664:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1789601555.552020:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.552042:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.552058:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601555.552108:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789601555.552151:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000657bf6b7 reply state 000000002dcade18 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.552166:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.552175:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:0.0:1789601555.552177:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601555.552182:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789601555.552221:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789601555.552350:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+29:10871:x1876532898353664:12345-192.168.203.48@tcp:36:bash.0 Request processed in 633us (1131us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789601555.552359:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 100 00000020:00080000:0.0:1789601555.552365:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789601555.559291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.560625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353792 00000100:00100000:3.0:1789601555.560643:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353792 00000100:00100000:3.0:1789601555.560732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:3.0:1789601555.560746:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:10871:x1876532898353792:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601555.560779:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601555.560806:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bd0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.560890:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd0 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.560907:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd0 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.560930:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.560934:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601555.560938:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528200, rc 0) 00000100:00100000:3.0:1789601555.561013:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+30:10871:x1876532898353792:12345-192.168.203.48@tcp:101:bash.0 Request processed in 270us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601555.561020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:1.0:1789601555.567796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.568606:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898353920 00000100:00100000:2.0:1789601555.568622:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898353920 00000100:00100000:2.0:1789601555.568705:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:2.0:1789601555.568718:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:10871:x1876532898353920:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601555.568742:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.568788:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bd7 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601555.568822:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab2711, atime: 0x6aab270f, ctime: 0x6aab2711, blocks: 0x8 00010000:00010000:2.0:1789601555.568864:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1789601555.568870:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601555.568880:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.568902:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.568917:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030000, rc 0) 00000100:00100000:2.0:1789601555.569000:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:10871:x1876532898353920:12345-192.168.203.48@tcp:101:bash.0 Request processed in 285us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601555.569007:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:0.0:1789601555.577705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601555.577890:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354048 00000100:00100000:1.0:1789601555.577905:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354048 00002000:00010000:1.0:1789601555.577962:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789601555.577967:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36ae300 with x1876532898354048 ext(0->18446744073709551615) 00002000:00010000:1.0:1789601555.577982:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c36ae300. 00000100:00100000:1.0:1789601555.578022:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1789601555.578034:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898354048:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:1.0:1789601555.578684:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789601555.578690:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789601553 -> 1789601555 00002000:00010000:1.0:1789601555.578694:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789601551 -> 1789601551 00002000:00010000:1.0:1789601555.578697:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789601553 -> 1789601555 00002000:00010000:1.0:1789601555.578700:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789601555.578782:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898354048:12345-192.168.203.48@tcp:10:bash.0 Request processed in 749us (1090us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789601555.578811:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00010000:1.0:1789601555.578816:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789601555.578819:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36ae300 with x1876532898354048 ext(0->18446744073709551615) 00002000:00010000:1.0:1789601555.578824:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c36ae300. 00000100:00100000:0.0:1789601555.702421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.702741:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354176 00000100:00100000:2.0:1789601555.702756:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354176 00000100:00100000:2.0:1789601555.702838:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:2.0:1789601555.702862:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+30:11359:x1876532898354176:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789601555.702962:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.702984:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.702999:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703037:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703045:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703052:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703155:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703167:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703174:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601555.703231:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703244:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703250:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703257:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703263:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.703268:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703283:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703297:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.703301:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.703308:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703314:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703343:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703349:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703355:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703360:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.703363:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703368:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703376:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601555.703378:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.703381:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703397:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703414:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703421:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703428:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703434:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.703437:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703443:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703463:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.703466:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.703477:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.703484:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601555.703999:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+30:11359:x1876532898354176:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1146us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601555.704010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:0.0:1789601555.748764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.748887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354432 00000100:00100000:2.0:1789601555.748901:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354432 00000100:00100000:2.0:1789601555.748976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:2.0:1789601555.748987:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+30:11362:x1876532898354432:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601555.749013:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.749036:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bde expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749126:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749142:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749156:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749192:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749348:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1c72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749357:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1c72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749383:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1c72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601555.749394:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789601555.749494:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749502:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749510:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749517:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.749522:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749531:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749546:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.749550:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.749597:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749605:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f1c64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749621:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749628:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749640:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749645:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.749648:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749654:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749662:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601555.749664:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.749668:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749674:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f1c6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749720:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f1c5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bde expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749734:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1c72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bde expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.749741:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.749744:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601555.749746:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:2.0:1789601555.749814:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+32:11362:x1876532898354432:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 829us (1065us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789601555.749833:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:3.0:1789601555.752673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601555.753234:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354560 00000100:00100000:0.0:1789601555.753246:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354560 00000100:00100000:0.0:1789601555.753321:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:0.0:1789601555.753343:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+32:11362:x1876532898354560:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789601555.753431:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.753464:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 32 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.753476:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.753550:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 32 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601555.753599:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 32 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601555.753615:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918364928:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601555.753719:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d1057180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601555.756723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.756837:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918364928:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601555.756882:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601555.757630:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354816 00000100:00100000:3.0:1789601555.757641:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354816 00000100:00100000:3.0:1789601555.757701:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789601555.757711:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:6187:x1876532898354816:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789601555.758776:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+34:6187:x1876532898354816:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 1061us (2060us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789601555.758803:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789601555.770256:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.773373:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898354944 00000100:00100000:3.0:1789601555.773399:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898354944 00010000:00010000:3.0:1789601555.773480:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 34 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601555.773541:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:3.0:1789601555.773552:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+34:2415:x1876532898354944:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601555.773589:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601555.773597:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 34 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773613:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 34 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773641:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f1c17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc2 expref: 34 pid: 9040 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773663:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.773670:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773682:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773691:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.773749:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601555.773826:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:2415:x1876532898354944:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 275us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601555.773834:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00010000:00010000:2.0:1789601555.774082:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774093:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774144:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774152:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774170:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774178:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.774184:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774192:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774204:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.774207:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601555.774212:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.774225:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1c80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601555.774275:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+32:11362:x1876532898354560:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 20936us (21616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601555.774284:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:3.0:1789601555.781862:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601555.781893:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918365056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601555.781992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601555.782085:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918365056 00000100:00100000:2.0:1789601555.782096:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918365056 00000100:00100000:2.0:1789601555.782157:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789601555.782173:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918365056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601555.782214:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789601555.782284:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918365056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601555.782291:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789601555.782406:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918365056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601555.782928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601555.782989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898355200 00000100:00100000:3.0:1789601555.782995:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898355200 00000100:00100000:3.0:1789601555.783037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:3.0:1789601555.783045:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+32:11362:x1876532898355200:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601555.783284:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+33:11362:x1876532898355200:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 239us (359us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789601555.783293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601555.875364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.876698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898355456 00000100:00100000:2.0:1789601555.876723:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898355456 00000100:00100000:2.0:1789601555.877024:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:2.0:1789601555.877041:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:11373:x1876532898355456:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789601555.877077:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601555.877104:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1c87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48be5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877220:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877239:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877273:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877294:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877302:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877308:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877487:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1c9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877498:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1c9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877505:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1c9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601555.877516:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789601555.877653:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877661:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877669:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877675:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.877686:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877695:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877709:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.877712:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.877719:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1c8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877746:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877752:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877757:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.877759:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877765:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601555.877774:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.877793:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877800:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1c95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877863:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1c87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48be5 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877880:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1c9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48be5 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.877889:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.877891:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601555.877894:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601555.877979:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+35:11373:x1876532898355456:12345-192.168.203.48@tcp:101:cat.0 Request processed in 943us (2629us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789601555.877988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:1.0:1789601555.891352:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601555.891440:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898355712 00000100:00100000:0.0:1789601555.891457:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898355712 00000100:00100000:0.0:1789601555.891526:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601555.891539:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:11373:x1876532898355712:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:0.0:1789601555.891939:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+36:11373:x1876532898355712:12345-192.168.203.48@tcp:35:cat.0 Request processed in 401us (612us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789601555.891948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601555.918003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601555.918106:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898355968 00000100:00100000:2.0:1789601555.918129:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898355968 00000100:00100000:2.0:1789601555.918207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:2.0:1789601555.918221:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+36:11374:x1876532898355968:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:2.0:1789601555.918299:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789601555.918346:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1c3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd0 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918376:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1c9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48be5 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918413:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1c72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bde expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918425:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1c2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bc9 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918435:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.918440:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601555.918466:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918481:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918492:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918509:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918516:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918523:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918847:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918858:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.918872:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601555.919133:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789601555.919142:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424040584813ns, next at 425040581805ns, rc = 0 00010000:00010000:2.0:1789601555.919191:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919200:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919209:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919217:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919223:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919228:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919244:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601555.919263:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919267:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919272:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919284:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.919289:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919295:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919303:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601555.919305:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789601555.919308:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919312:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919339:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919345:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919351:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919356:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601555.919359:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919365:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919385:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601555.919387:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601555.919391:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919396:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1caa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601555.919406:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4af2e77 reply state 000000009ab9d00d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919417:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601555.919422:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601555.919424:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601555.919427:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601555.919513:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+34:11374:x1876532898355968:12345-192.168.203.48@tcp:36:rm.0 Request processed in 1294us (1527us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789601555.919522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 106 00010000:00010000:3.0:1789601555.920350:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601555.920362:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.920371:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601555.920375:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.920383:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.920398:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:3.0:1789601555.920401:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789601555.920415:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.920422:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1cbf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601555.920435:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601555.920498:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601555.920500:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601555.983005:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601555.983391:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356224 00000100:00100000:1.0:1789601555.983405:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356224 00000100:00100000:1.0:1789601555.983493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:1.0:1789601555.983505:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+34:11380:x1876532898356224:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601555.983537:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601555.983621:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1cc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984099:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984119:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984132:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984144:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984152:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.984175:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601555.985051:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789601555.985238:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985251:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985261:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985301:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985308:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985314:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985319:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601555.985335:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985343:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985357:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601555.985360:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601555.985375:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985381:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1ccd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601555.985396:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006498bd85 reply state 000000002bd048c7 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985409:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.985415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:1.0:1789601555.985417:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601555.985420:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789601555.985460:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1cc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.986714:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601555.986729:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:1.0:1789601555.986732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601555.986735:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eec00, rc 0) 00000100:00100000:1.0:1789601555.987095:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+37:11380:x1876532898356224:12345-192.168.203.48@tcp:101:bash.0 Request processed in 3590us (4102us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789601555.987105:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:1.0:1789601556.000249:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.000441:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356352 00000100:00100000:3.0:1789601556.000454:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356352 00000100:00100000:3.0:1789601556.000525:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:3.0:1789601556.000539:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2417:x1876532898356352:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601556.000608:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601556.000640:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bf3 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601556.000675:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601556.000707:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1789601556.000713:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601556.000725:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.000999:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.001016:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601556.001086:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898356352:12345-192.168.203.48@tcp:101:bash.0 Request processed in 550us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.001114:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1789601556.005868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.006123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356480 00000100:00100000:2.0:1789601556.006135:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356480 00000100:00100000:2.0:1789601556.006240:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1789601556.006254:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:11380:x1876532898356480:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601556.006280:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601556.006303:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48bfa expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.006355:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.006382:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.006387:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.006394:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.006452:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.006469:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.006486:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1876532918365184:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601556.007125:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789601556.007196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601556.016816:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1876532918365184:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601556.017243:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.017272:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382c00, rc 0) 00000100:00100000:2.0:1789601556.017351:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+9:11380:x1876532898356480:12345-192.168.203.48@tcp:101:bash.0 Request processed in 11100us (11494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.017361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1789601556.017698:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.017909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356608 00000100:00100000:2.0:1789601556.017917:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356608 00010000:00010000:2.0:1789601556.017953:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.018004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1789601556.018014:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898356608:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601556.018031:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601556.018057:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.018072:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.018098:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c98b16cf/0x74872e3eca9f1ce9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bf3 expref: 9 pid: 8440 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.018115:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.018120:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.018128:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.018141:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.018279:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.018296:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876532918365312:192.168.203.48@tcp:105: 00000100:00100000:2.0:1789601556.018437:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601556.024244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.024337:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356864 00000100:00100000:0.0:1789601556.024350:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356864 00000100:00100000:0.0:1789601556.024431:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1789601556.024443:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+37:11380:x1876532898356864:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:2.0:1789601556.025299:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876532918365312:192.168.203.48@tcp:105: 00010000:00010000:2.0:1789601556.025339:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601556.025399:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+38:11380:x1876532898356864:12345-192.168.203.48@tcp:35:bash.0 Request processed in 958us (1169us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789601556.025431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789601556.035676:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898356608:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 17643us (17959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.035695:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00010000:00010000:3.0:1789601556.101764:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601556.208249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.208389:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898356992 00000100:00100000:2.0:1789601556.208413:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898356992 00000100:00100000:2.0:1789601556.208489:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:2.0:1789601556.208503:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+38:11396:x1876532898356992:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601556.208532:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601556.209834:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c01 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211092:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211113:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211129:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601556.211190:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789601556.211195:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601556.211220:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211255:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c01 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211290:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c01 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.211299:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601556.211303:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601556.211307:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:2.0:1789601556.211412:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+39:11396:x1876532898356992:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2912us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.211424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:1.0:1789601556.224189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.224297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898357248 00000100:00100000:2.0:1789601556.224310:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898357248 00000100:00100000:2.0:1789601556.224402:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:2.0:1789601556.224414:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+39:11396:x1876532898357248:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601556.224442:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601556.224470:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1d05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c08 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.226080:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1d0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.226106:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.226122:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601556.226139:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789601556.226316:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1d05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c08 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.226353:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c08 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.226365:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:2.0:1789601556.226369:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601556.226374:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382200, rc 0) 00000100:00100000:2.0:1789601556.226472:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+41:11396:x1876532898357248:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2058us (2297us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789601556.226482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:3.0:1789601556.235421:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.235483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.235689:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898357376 00000100:00100000:2.0:1789601556.235702:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898357376 00000100:00100000:2.0:1789601556.235798:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601556.235811:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+41:2416:x1876532898357376:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601556.235830:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789601556.236136:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898357632 00000100:00100000:0.0:1789601556.236142:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898357632 00000100:00100000:0.0:1789601556.236183:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:0.0:1789601556.236191:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+42:11396:x1876532898357632:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601556.236216:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601556.236237:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1d1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c0f expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.236239:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1d0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c08 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.236260:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:2.0:1789601556.236266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601556.236340:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+42:2416:x1876532898357376:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 531us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.236348:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00010000:00010000:0.0:1789601556.236416:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.236434:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.236447:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601556.236462:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789601556.237857:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1d1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c0f expref: 43 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.237886:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c0f expref: 42 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.237897:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:0.0:1789601556.237900:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789601556.237917:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601556.237991:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+42:11396:x1876532898357632:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1800us (2507us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789601556.238000:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:3.0:1789601556.251278:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.251452:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898357760 00000100:00100000:2.0:1789601556.251466:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898357760 00000100:00100000:2.0:1789601556.251694:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:2.0:1789601556.251709:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898357760:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:2.0:1789601556.251785:0:8857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.251813:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.251823:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.251829:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601556.251834:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.252697:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.252721:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 8 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.252739:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8857:1876532918365440:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601556.253739:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601556.261958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.262084:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898357888 00000100:00100000:0.0:1789601556.262096:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898357888 00002000:00100000:0.0:1789601556.262169:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8df4f73b0380 x1876532898357888/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:152/0 lens 504/0 e 0 to 0 dl 1789601567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601556.262183:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4f73b0380 with x1876532898357888 ext(0->8) 00010000:00010000:0.0:1789601556.262195:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.262214:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601556.262223:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df4f73b0380 00000100:00100000:0.0:1789601556.262255:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:0.0:1789601556.262265:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898357888:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:3.0:1789601556.263951:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8857:1876532918365440:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601556.263990:0:8857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601556.266874:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:2415:x1876532898357888:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 4593us (4912us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789601556.266891:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00100000:0.0:1789601556.266911:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8df4f73b0380 x1876532898357888/t4294967303(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:152/0 lens 504/448 e 0 to 0 dl 1789601567 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601556.266923:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4f73b0380 with x1876532898357888 ext(0->8) 00010000:00010000:0.0:1789601556.266938:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.266983:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601556.266992:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df4f73b0380 00000100:00100000:1.0:1789601556.273484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.273654:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358016 00000100:00100000:3.0:1789601556.273667:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358016 00010000:00010000:3.0:1789601556.273945:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.273999:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1789601556.274012:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3639050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:2417:x1876532898358016:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601556.274031:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789601556.274055:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789601556.274058:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789601555 00002000:00010000:3.0:1789601556.274060:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789601556 00002000:00010000:3.0:1789601556.274063:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789601555 00002000:00010000:3.0:1789601556.274065:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789601556.274072:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.274097:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.274125:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023f2c399/0x74872e3eca9f1cf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bfa expref: 11 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.274147:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601556.274152:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601556.274159:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.274171:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.274214:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601556.274283:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3639050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+10:2417:x1876532898358016:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 273us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.274291:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00010000:00010000:0.0:1789601556.275551:0:8857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275606:0:8857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275642:0:8857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275652:0:8857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275661:0:8857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275669:0:8857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601556.275675:0:8857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275685:0:8857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275729:0:8857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.275739:0:8857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ee03b6/0x74872e3eca9f1d2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601556.275836:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898357760:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 24129us (24571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.275846:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789601556.278073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.278158:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358272 00000100:00100000:3.0:1789601556.278171:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358272 00000100:00100000:3.0:1789601556.278238:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789601556.278251:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0982050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+42:11396:x1876532898358272:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:3.0:1789601556.278339:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c0f expref: 42 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601556.279177:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789601556.279217:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789601556.281217:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789601556.281293:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.281315:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.281337:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.281387:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.282509:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 46 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.282537:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876532918365568:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601556.285631:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601556.287766:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876532918365568:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601556.287805:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601556.290149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.290705:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358400 00000100:00100000:2.0:1789601556.290718:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358400 00010000:00010000:2.0:1789601556.290832:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 47 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.290978:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789601556.290991:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+47:2416:x1876532898358400:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601556.291012:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601556.291022:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 47 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291038:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 47 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291063:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1cdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bec expref: 47 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291084:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:2.0:1789601556.291089:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291100:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291109:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.291149:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601556.291253:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+46:2416:x1876532898358400:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 264us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.291262:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00010000:00010000:3.0:1789601556.294261:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.294287:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601556.294469:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789601556.294682:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789601556.295115:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918365696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601556.295214:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601556.295256:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601556.295310:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918365696 00000100:00100000:0.0:1789601556.295320:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918365696 00000100:00100000:0.0:1789601556.295411:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789601556.295421:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1876532918365696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789601556.295533:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1876532918365696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.295541:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1789601556.296547:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601556.296654:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918365696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601556.297137:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789601556.297243:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918365824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601556.297310:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601556.297403:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601556.297950:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601556.297968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918365952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601556.298006:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601556.299032:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918365824 00000100:00100000:0.0:1789601556.299046:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918365824 00000100:00100000:0.0:1789601556.299095:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918365952 00000100:00100000:0.0:1789601556.299098:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918365952 00000100:00100000:0.0:1789601556.299117:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789601556.299127:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1876532918365824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789601556.299481:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6525:x1876532918365824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 354us (2170us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789601556.299490:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789601556.299537:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789601556.299544:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918365952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601556.299710:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789601556.299758:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918365952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 215us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.299765:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789601556.299936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918365952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601556.300709:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918365824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789601556.300927:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789601556.300994:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301005:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301012:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301018:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601556.301023:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301031:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301049:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:1.0:1789601556.301052:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789601556.301058:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.301064:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1d36 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601556.301298:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789601556.301392:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789601556.301413:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424422855561ns, next at 425422844364ns, rc = 0 00000001:00080000:1.0:1789601556.301421:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789601556.301450:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:1.0:1789601556.301453:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789601556.301462:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c0f expref: 50 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601556.301804:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0982050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+49:11396:x1876532898358272:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 23554us (23741us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789601556.301815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000020:00080000:1.0:1789601556.301821:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789601556.305427:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.305925:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358528 00000100:00100000:0.0:1789601556.305938:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358528 00000100:00100000:0.0:1789601556.306017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:0.0:1789601556.306029:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+49:11396:x1876532898358528:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601556.306062:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601556.306091:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1d3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c16 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.306272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1d3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c16 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.306292:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1d3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c16 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.306315:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.306319:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601556.306334:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467200, rc 0) 00000100:00100000:0.0:1789601556.306440:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+50:11396:x1876532898358528:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 413us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.306447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:2.0:1789601556.317766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.317981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358784 00000100:00100000:0.0:1789601556.317997:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358784 00000100:00100000:0.0:1789601556.318100:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601556.318113:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+50:11396:x1876532898358784:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601556.318468:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+51:11396:x1876532898358784:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 357us (717us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789601556.319036:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1789601556.483075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.483278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898358912 00000100:00100000:0.0:1789601556.483292:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898358912 00000100:00100000:0.0:1789601556.483427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:0.0:1789601556.483441:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+51:11406:x1876532898358912:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1789601556.483549:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.483605:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.483620:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.483633:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.483641:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.483648:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484001:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484028:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484038:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601556.484102:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484116:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484123:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484131:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484138:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.484142:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484150:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484178:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601556.484182:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.484189:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484196:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484220:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484226:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484233:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484238:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.484242:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484248:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484256:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:0.0:1789601556.484259:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.484262:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484268:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484278:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484285:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484291:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484302:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.484305:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484311:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484319:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.484332:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.484336:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.484342:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1d52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601556.484457:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+51:11406:x1876532898358912:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1016us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.484467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:2.0:1789601556.538118:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.538228:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898359168 00000100:00100000:1.0:1789601556.538242:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898359168 00000100:00100000:1.0:1789601556.538319:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:1.0:1789601556.538340:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+51:11409:x1876532898359168:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601556.538369:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.538394:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1d59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c1d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538491:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538509:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538599:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538610:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538618:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538761:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1d6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538782:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1d6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538791:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1d6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601556.538807:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789601556.538921:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538929:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538936:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538943:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601556.538947:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538966:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538979:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601556.538982:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601556.538988:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.538994:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f1d60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539008:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539013:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539018:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539023:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601556.539025:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539030:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:1.0:1789601556.539038:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601556.539041:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539054:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539094:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1d59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c1d expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539108:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1d6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c1d expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.539116:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601556.539118:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601556.539121:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef600, rc 0) 00000100:00100000:1.0:1789601556.539201:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+53:11409:x1876532898359168:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 862us (1107us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789601556.539209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:3.0:1789601556.542515:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.542976:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898359296 00000100:00100000:2.0:1789601556.542990:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898359296 00000100:00100000:2.0:1789601556.543074:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:2.0:1789601556.543088:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+53:11409:x1876532898359296:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789601556.543421:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543443:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543458:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543507:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543516:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543525:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.543532:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601556.543537:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.544748:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.544767:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:2.0:1789601556.544771:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601556.545236:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.545245:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1d7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.545393:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+53:11409:x1876532898359296:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 2302us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.545405:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:2.0:1789601556.553230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.553308:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898359552 00000100:00100000:1.0:1789601556.553332:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898359552 00000100:00100000:1.0:1789601556.553424:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789601556.553436:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+53:11409:x1876532898359552:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601556.554288:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+54:11409:x1876532898359552:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 848us (1067us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789601556.554300:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601556.712824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.713261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898359808 00000100:00100000:1.0:1789601556.713275:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898359808 00000100:00100000:1.0:1789601556.713368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:1.0:1789601556.713381:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+54:11419:x1876532898359808:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601556.713435:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.713440:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601556.713472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1cfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c01 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713496:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601556.713503:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601556.713527:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1d83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c24 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713728:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713747:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713760:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601556.713774:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789601556.713914:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f1d83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c24 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713931:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c24 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.713939:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601556.713942:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601556.713946:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601556.714044:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+55:11419:x1876532898359808:12345-192.168.203.48@tcp:101:bash.0 Request processed in 665us (1232us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789601556.714052:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:2.0:1789601556.718710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.718781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.719019:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360064 00000100:00100000:3.0:1789601556.719031:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360064 00000100:00100000:3.0:1789601556.719116:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789601556.719128:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+55:2415:x1876532898360064:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601556.719149:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601556.719192:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f1d8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c24 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.719218:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601556.719225:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601556.719298:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+54:2415:x1876532898360064:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 173us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.719307:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1789601556.719398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898359936 00000100:00100000:0.0:1789601556.719404:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898359936 00000100:00100000:0.0:1789601556.719447:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1789601556.719456:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+54:11419:x1876532898359936:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601556.719481:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601556.719502:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c2b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719543:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719615:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719629:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719767:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1d98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719796:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.719804:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.719807:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601556.719810:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466c00, rc 0) 00000100:00100000:0.0:1789601556.719854:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+55:11419:x1876532898359936:12345-192.168.203.48@tcp:101:bash.0 Request processed in 400us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.719861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:2.0:1789601556.732135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.732234:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360320 00000100:00100000:0.0:1789601556.732247:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360320 00000100:00100000:0.0:1789601556.732338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:0.0:1789601556.732351:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+55:11419:x1876532898360320:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1789601556.732436:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601556.732471:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f1d6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c1d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.732493:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.732526:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601556.733003:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.733021:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.733032:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601556.733087:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789601556.733112:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073e08ed4 reply state 000000000e43457e transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.733124:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.733131:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.733134:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601556.733137:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601556.733264:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+57:11419:x1876532898360320:12345-192.168.203.48@tcp:36:bash.0 Request processed in 915us (1150us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789601556.733273:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000020:00080000:0.0:1789601556.733280:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789601556.741915:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.742056:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360448 00000100:00100000:0.0:1789601556.742070:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360448 00000100:00100000:0.0:1789601556.742147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:0.0:1789601556.742169:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+57:11419:x1876532898360448:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601556.742201:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601556.742227:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c32 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742376:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742394:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742407:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601556.742446:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789601556.742450:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601556.742472:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742502:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742533:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.742542:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.742546:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601556.742550:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466e00, rc 0) 00000100:00100000:0.0:1789601556.742655:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+58:11419:x1876532898360448:12345-192.168.203.48@tcp:101:bash.0 Request processed in 488us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.742663:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1789601556.751262:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.751499:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360704 00000100:00100000:0.0:1789601556.751512:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360704 00000100:00100000:0.0:1789601556.751635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789601556.751647:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+58:11419:x1876532898360704:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1789601556.752337:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+59:11419:x1876532898360704:12345-192.168.203.48@tcp:35:bash.0 Request processed in 689us (1086us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789601556.752346:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:2.0:1789601556.823520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.823743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360832 00000100:00100000:1.0:1789601556.823756:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360832 00000100:00100000:1.0:1789601556.823841:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:1.0:1789601556.823853:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+59:11425:x1876532898360832:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601556.824067:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.824095:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c39 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824280:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824313:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601556.824381:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789601556.824384:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601556.824408:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824439:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c39 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824647:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c39 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.824657:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601556.824661:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601556.824665:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1200, rc 0) 00000100:00100000:1.0:1789601556.824810:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898360832:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 958us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601556.824819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:1.0:1789601556.829769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.830058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898360960 00000100:00100000:0.0:1789601556.830072:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898360960 00000100:00100000:0.0:1789601556.830295:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:0.0:1789601556.830309:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898360960:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601556.830349:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601556.830375:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f1dc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c40 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830466:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830693:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830712:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830730:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830738:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.830745:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831059:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831070:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831077:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601556.831392:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789601556.831398:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601556.831427:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831441:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831450:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831457:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831465:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.831988:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.831995:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832005:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832034:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601556.832037:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.832043:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832067:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f1dd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832089:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832096:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832102:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832235:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.832238:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832245:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832255:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:0.0:1789601556.832257:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.832260:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832266:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1dd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832335:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f1dc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832353:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.832361:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.832363:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601556.832366:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467400, rc 0) 00000100:00100000:0.0:1789601556.832753:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+61:11425:x1876532898360960:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2446us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.832764:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:0.0:1789601556.837538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.837638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.837774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361216 00000100:00100000:1.0:1789601556.837799:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361216 00000100:00100000:1.0:1789601556.837890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:1.0:1789601556.837905:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:11425:x1876532898361216:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601556.837932:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.837964:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1de5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c47 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838115:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838135:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838144:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838174:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838218:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838234:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601556.838251:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918366080:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601556.838400:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.838410:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601556.838419:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918366208:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601556.838445:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c30aef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601556.838710:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361344 00000100:00100000:3.0:1789601556.838717:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361344 00010000:00010000:3.0:1789601556.838750:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 63 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.838808:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:3.0:1789601556.838818:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:2418:x1876532898361344:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601556.838842:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601556.838850:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 63 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.838871:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 63 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.838893:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601556.838898:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.838915:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.838922:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601556.838962:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:2418:x1876532898361344:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 145us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.838970:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:2.0:1789601556.843181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1789601556.843300:0:6521:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.48@tcp) returned -22 from blocking AST (req@000000003d03b500 x1876532918366080) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.843336:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1dde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c40 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601556.843356:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918366080:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601556.843387:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918366208:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601556.843416:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601556.843422:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.843434:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.843445:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.843743:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361472 00000100:00100000:3.0:1789601556.843753:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361472 00010000:00010000:3.0:1789601556.843802:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.843846:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:3.0:1789601556.843856:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+62:2416:x1876532898361472:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601556.844002:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601556.844010:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844025:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844049:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1db4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c32 expref: 62 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844061:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601556.844065:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844075:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844084:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.844118:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601556.844249:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.844258:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601556.844282:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789601556.844464:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1de5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.844483:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.844491:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601556.844493:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601556.844496:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1e00, rc 0) 00000100:00100000:3.0:1789601556.844592:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+62:2416:x1876532898361472:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 735us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.844602:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:1.0:1789601556.847077:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:11425:x1876532898361216:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 9160us (9540us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789601556.847120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1789601556.851996:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.852144:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361728 00000100:00100000:3.0:1789601556.852166:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361728 00000100:00100000:3.0:1789601556.852250:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1789601556.852263:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:11425:x1876532898361728:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:3.0:1789601556.852303:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601556.852354:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1d3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c16 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.852377:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601556.852383:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601556.852458:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898361728:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 198us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.852465:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789601556.856371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.856620:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361856 00000100:00100000:3.0:1789601556.856634:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361856 00000100:00100000:3.0:1789601556.856700:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:3.0:1789601556.856714:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898361856:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:3.0:1789601556.856908:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.856932:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.856946:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601556.857085:0:9040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789601556.857210:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898361856:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 499us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.857219:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:2.0:1789601556.860390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.860509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898361984 00000100:00100000:1.0:1789601556.860521:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898361984 00000100:00100000:1.0:1789601556.860627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:1.0:1789601556.860640:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+60:11425:x1876532898361984:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601556.860664:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.860694:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c4e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.860767:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.860791:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.860814:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.860829:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.860856:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601556.860860:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601556.861219:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.861233:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e0a00, rc 0) 00000100:00100000:1.0:1789601556.861365:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+61:11425:x1876532898361984:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 727us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601556.861372:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000040:00080000:3.0:1789601556.870456:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601556.870469:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601556.870523:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789601556.870535:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601556.875381:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918366336:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601556.875606:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601556.886337:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918366336:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789601556.894224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.894352:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898362112 00000100:00100000:3.0:1789601556.894365:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898362112 00000100:00100000:3.0:1789601556.894435:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:3.0:1789601556.894446:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:11426:x1876532898362112:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601556.894484:0:9040:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601556.894642:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:11426:x1876532898362112:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 197us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.894650:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:2.0:1789601556.901344:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.901454:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898362240 00000100:00100000:0.0:1789601556.901476:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898362240 00000100:00100000:0.0:1789601556.901551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:0.0:1789601556.901600:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:11426:x1876532898362240:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789601556.901703:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901726:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901787:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901807:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901815:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901823:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901853:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901876:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901883:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601556.901942:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789601556.901958:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601556.901976:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901989:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.901996:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902031:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902038:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.902043:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902052:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902065:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:0.0:1789601556.902069:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.902076:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902082:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902098:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902104:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902109:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902114:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.902117:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902133:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.902142:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8df4c99bb700) 00010000:00010000:0.0:1789601556.902144:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.902148:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e0f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903137:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903144:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903162:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903169:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.903173:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903180:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903192:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:0.0:1789601556.903195:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.903199:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.903220:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f1e16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601556.903349:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:11426:x1876532898362240:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1747us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.903359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:1.0:1789601556.906254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.906684:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898362496 00000100:00100000:3.0:1789601556.906697:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898362496 00000100:00100000:3.0:1789601556.906766:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:3.0:1789601556.906778:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:11426:x1876532898362496:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601556.906804:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601556.906840:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c55 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.906982:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907002:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907017:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601556.907051:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789601556.907169:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907177:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907185:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907192:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601556.907197:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907205:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907220:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601556.907223:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789601556.907230:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907237:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1e24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907287:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e1d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c55 expref: 63 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907299:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:3.0:1789601556.907302:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601556.907311:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c55 expref: 63 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.907334:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528400, rc 0) 00000100:00100000:3.0:1789601556.907741:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898362496:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 963us (1498us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789601556.907751:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:1.0:1789601556.913771:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.914001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898362624 00000100:00100000:2.0:1789601556.914014:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898362624 00000100:00100000:2.0:1789601556.914133:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1789601556.914147:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898362624:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601556.914223:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601556.914384:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898362624:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 240us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.914392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:1.0:1789601556.923341:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.924027:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898362880 00000100:00100000:1.0:1789601556.924041:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898362880 00000100:00100000:1.0:1789601556.924123:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:1.0:1789601556.924134:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898362880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601556.924166:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.924169:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601556.924203:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c39 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.924225:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601556.924232:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601556.924247:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1e32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c5c expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601556.924746:0:9040:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789601556.925365:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.925385:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.925398:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.926011:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1e32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c5c expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.926038:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c5c expref: 63 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.926049:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:1.0:1789601556.926053:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601556.926058:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1c00, rc 0) 00000100:00100000:1.0:1789601556.926416:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:11426:x1876532898362880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2282us (3094us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789601556.926428:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:1.0:1789601556.933015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.933130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898363136 00000100:00100000:0.0:1789601556.933145:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898363136 00000100:00100000:0.0:1789601556.933347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:0.0:1789601556.933361:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+63:11426:x1876532898363136:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789601556.933444:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601556.933487:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1e39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c5c expref: 63 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933511:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9c00) 00010000:00010000:0.0:1789601556.933525:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601556.933552:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933617:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933631:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933657:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933681:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933739:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933747:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933755:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933762:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.933768:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933776:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:0.0:1789601556.933789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.933793:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933799:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1e47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933810:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933817:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933830:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933845:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601556.933848:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933854:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933862:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb8317d72 (ffff8df4c99bb700) 00010000:00010000:0.0:1789601556.933930:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601556.933935:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601556.933941:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1e4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb8317d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601556.934043:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898363136:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 685us (1041us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601556.934056:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:0.0:1789601556.936889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.937086:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898363264 00000100:00100000:1.0:1789601556.937099:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898363264 00000100:00100000:1.0:1789601556.937183:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:1.0:1789601556.937195:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+62:11426:x1876532898363264:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601556.937219:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.937250:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1e55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c63 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937295:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937312:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937360:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937499:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937523:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 63 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.937533:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:1.0:1789601556.937536:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601556.937541:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1200, rc 0) 00000100:00100000:1.0:1789601556.938041:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:11426:x1876532898363264:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 846us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601556.938050:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:1.0:1789601556.943573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.943764:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898363520 00000100:00100000:2.0:1789601556.943777:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898363520 00000100:00100000:2.0:1789601556.943961:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:2.0:1789601556.943976:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+63:11426:x1876532898363520:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601556.944725:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.944750:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.944766:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601556.945129:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789601556.945144:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425066586813ns, next at 426066582689ns, rc = 0 00000004:00010000:2.0:1789601556.945224:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000951eb28 reply state 00000000380e9163 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.945241:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.945250:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:2.0:1789601556.945253:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789601556.945259:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601556.945463:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:11426:x1876532898363520:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1488us (1920us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789601556.945491:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:1.0:1789601556.949910:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.950041:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898363648 00000100:00100000:3.0:1789601556.950054:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898363648 00000100:00100000:3.0:1789601556.950127:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:3.0:1789601556.950140:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+65:11426:x1876532898363648:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601556.950183:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601556.950211:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c6a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.950290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.950308:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.950341:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:3.0:1789601556.950344:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601556.950353:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528400, rc 0) 00000100:00100000:3.0:1789601556.950904:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:11426:x1876532898363648:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 764us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601556.950913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:1.0:1789601556.964539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.964997:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898363776 00000100:00100000:3.0:1789601556.965011:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898363776 00000100:00080000:1.0:1789601556.965236:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601556.965268:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789601556.965286:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898363776:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789601556.966008:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898363776:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 725us (1482us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789601556.966018:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:1.0:1789601556.969970:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601556.970076:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364032 00000100:00100000:3.0:1789601556.970090:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364032 00000100:00100000:3.0:1789601556.970301:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:3.0:1789601556.970315:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:11426:x1876532898364032:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789601556.970677:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:11426:x1876532898364032:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 365us (722us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789601556.970687:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789601556.973620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601556.973769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364288 00000100:00100000:0.0:1789601556.973783:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364288 00000100:00100000:0.0:1789601556.973860:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:0.0:1789601556.973882:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+67:11426:x1876532898364288:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789601556.974031:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+67:11426:x1876532898364288:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 151us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601556.974058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:3.0:1789601556.976644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.976760:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364416 00000100:00100000:2.0:1789601556.976771:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364416 00000100:00100000:2.0:1789601556.976844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:2.0:1789601556.976857:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:11426:x1876532898364416:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601556.976893:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601556.976918:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1e71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c71 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977012:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977030:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977045:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601556.977116:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601556.977142:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977347:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f1e71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c71 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977370:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c71 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.977380:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:2.0:1789601556.977400:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601556.977405:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601556.977487:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+68:11426:x1876532898364416:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 632us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.977494:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:3.0:1789601556.981135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.981728:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364544 00000100:00100000:1.0:1789601556.981743:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364544 00000100:00100000:1.0:1789601556.981884:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:1.0:1789601556.981897:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898364544:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601556.981921:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601556.981966:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c78 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601556.981999:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab2714, blocks: 0x0 00010000:00010000:1.0:1789601556.982025:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1789601556.982031:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601556.982042:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.982066:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.982084:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1c00, rc 0) 00000100:00100000:1.0:1789601556.982396:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+10:2415:x1876532898364544:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 499us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601556.982404:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1789601556.985274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.985391:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364800 00000100:00100000:2.0:1789601556.985406:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364800 00000100:00100000:2.0:1789601556.985484:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:2.0:1789601556.985496:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+68:11426:x1876532898364800:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601556.985654:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+68:11426:x1876532898364800:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601556.985662:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:3.0:1789601556.988925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601556.989223:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898364928 00000100:00100000:2.0:1789601556.989237:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898364928 00000100:00100000:2.0:1789601556.989313:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:2.0:1789601556.989340:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+10:11426:x1876532898364928:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601556.989366:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601556.989391:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c7f expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.989432:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.989444:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.989449:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601556.989456:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.989519:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601556.989537:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601556.989586:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1876532918366464:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601556.989809:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601556.993849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601556.994408:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1876532918366464:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601556.994459:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601556.994548:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383a00, rc 0) 00000100:00100000:1.0:1789601556.994698:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+11:11426:x1876532898364928:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 5360us (5785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601556.994709:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789601556.994976:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365056 00000100:00100000:3.0:1789601556.994986:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365056 00010000:00010000:3.0:1789601556.995033:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.995075:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1789601556.995086:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:2416:x1876532898365056:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601556.995114:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601556.995334:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.995351:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.995378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ff64524/0x74872e3eca9f1e7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c78 expref: 11 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.995395:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601556.995400:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601556.995411:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.995423:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601556.995467:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601556.995493:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1876532918366592:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789601556.995597:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601557.000465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.000720:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1876532918366592:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789601557.000752:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601557.000821:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+10:2416:x1876532898365056:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 5736us (6989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.001701:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1789601557.002244:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365184 00000100:00100000:2.0:1789601557.002257:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365184 00002000:00100000:2.0:1789601557.002344:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8df4d0159880 x1876532898365184/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:153/0 lens 504/0 e 0 to 0 dl 1789601568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601557.002359:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4d0159880 with x1876532898365184 ext(0->12) 00002000:00010000:2.0:1789601557.002367:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df4d0159880 00000100:00100000:2.0:1789601557.002403:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601557.002415:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+10:2416:x1876532898365184:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601557.004445:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+12:2416:x1876532898365184:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 2017us (3980us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789601557.004461:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:2.0:1789601557.004475:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8df4d0159880 x1876532898365184/t4294967309(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:153/0 lens 504/448 e 0 to 0 dl 1789601568 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601557.004486:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df4d0159880 with x1876532898365184 ext(0->12) 00002000:00010000:2.0:1789601557.004509:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df4d0159880 00000100:00100000:1.0:1789601557.007789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601557.007991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365312 00000100:00100000:0.0:1789601557.008004:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365312 00000100:00100000:0.0:1789601557.008165:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:0.0:1789601557.008182:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+68:11426:x1876532898365312:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1789601557.009229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789601557.012933:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789601557.012959:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789601557.013007:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789601557.013034:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4f8bf8600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789601557.013039:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7330200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4f8bf8840 00000020:00080000:0.0:1789601557.013043:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7330700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df4d2330a00 00000004:00080000:0.0:1789601557.013074:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789601557.013099:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4d98323c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789601557.013101:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7330f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4c506bf00 00000020:00080000:0.0:1789601557.013104:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7330100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c20fba00 00000100:00100000:0.0:1789601557.013282:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:11426:x1876532898365312:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 5100us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.013293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:1.0:1789601557.013592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918366848:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789601557.013600:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013616:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013624:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013632:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efe00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.013638:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013647:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601557.013667:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:2.0:1789601557.013671:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.013678:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013686:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f1b8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601557.013718:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d015b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918366720:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789601557.013720:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013729:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013736:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013752:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601557.013765:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.013770:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013777:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013787:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918366848 00010000:00010000:2.0:1789601557.013788:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df3c341c600) 00010000:00010000:2.0:1789601557.013793:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.013796:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013799:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918366848 00010000:00010000:2.0:1789601557.013806:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1c33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013830:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013837:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013843:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013849:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.013852:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013859:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013862:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918366720 00000100:00100000:1.0:1789601557.013879:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918366720 00010000:00010000:2.0:1789601557.013882:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601557.013887:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.013891:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013898:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f1cb1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013907:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789601557.013914:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.013919:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918366848:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789601557.013927:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013935:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013941:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.013944:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013950:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013958:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df3c341cb00) 00010000:00010000:2.0:1789601557.013961:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.013964:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013971:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f1cd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013992:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.013999:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014006:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014011:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.014014:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014020:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014028:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:2.0:1789601557.014030:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.014033:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014038:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1da6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014047:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014052:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014059:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014071:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.014074:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.014080:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601557.014086:0:8857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:2.0:1789601557.014091:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00002000:00010000:1.0:1789601557.014091:0:8857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789601556 00010000:00010000:2.0:1789601557.014097:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00002000:00010000:1.0:1789601557.014099:0:8857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789601557.014103:0:8857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789601556 -> 1789601556 00010000:00010000:2.0:1789601557.014104:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601557.014108:0:8857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789601557.014117:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e63 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789601557.014139:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789601557.014188:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789601557.015224:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918366976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789601557.015277:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601557.015776:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1876532918366848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1857us (2113us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789601557.015789:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601557.015823:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918366976 00000100:00100000:1.0:1789601557.015832:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918366976 00000100:00100000:2.0:1789601557.015848:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601557.015864:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918366720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789601557.015893:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1789601557.015919:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.015943:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.015954:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789601557.015959:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601557.015975:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016014:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016030:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 11 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601557.016043:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1876532918367104:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601557.016052:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789601557.016062:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3645:x1876532918366976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789601557.016079:0:8857:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789601557.016118:0:8857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab2713, atime: 0x6aab2714, ctime: 0x6aab2713, blocks: 0x8 00000100:00100000:2.0:1789601557.016121:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5300 going to sleep for 11 seconds 00010000:00010000:1.0:1789601557.016126:0:8857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789601557.016141:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789601557.016153:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1789601557.016156:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601557.016162:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.016181:0:8857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.016192:0:8857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.016201:0:8857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.016227:0:8857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601557.016300:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601557.016309:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016328:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601557.016333:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016345:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016366:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016374:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b3818da/0x74872e3eca9f1e94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.016407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601557.016410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601557.016411:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601557.016436:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3645:x1876532918366976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 375us (1158us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789601557.016444:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1789601557.016505:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4fbc4df80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789601557.016512:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4fbc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918366848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1789601557.017327:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4cd0b9c00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789601557.017338:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918366976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789601557.023440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601557.023613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.023788:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1876532918367104:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601557.023824:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.024031:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365568 00000100:00100000:0.0:1789601557.024040:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365568 00010000:00010000:0.0:1789601557.024084:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 12 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.024145:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:0.0:1789601557.024155:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+12:2416:x1876532898365568:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601557.024171:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601557.024176:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 12 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.024188:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 12 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.024215:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc759a80/0x74872e3eca9f1c41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bd7 expref: 12 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.024237:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601557.024242:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601557.024249:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.024260:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.024293:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601557.024370:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+11:2416:x1876532898365568:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 213us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.024378:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00010000:00010000:3.0:1789601557.024545:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024573:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024586:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024595:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024615:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789601557.024630:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365440 00000100:00100000:2.0:1789601557.024635:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365440 00000100:00100000:2.0:1789601557.024666:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789601557.024673:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+11:2416:x1876532898365440:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789601557.024857:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1876532918366720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8998us (11104us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789601557.024932:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789601557.024957:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601557.024969:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024978:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601557.024983:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.024995:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.025011:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.025019:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2bfa0af/0x74872e3eca9f1e8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.025040:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601557.025041:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601557.025043:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789601557.025301:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4d015b480/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789601557.025309:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d015b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918366720:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789601557.028648:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789601557.028669:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1789601557.029123:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898365440:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 4440us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601557.029136:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1789601557.033812:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601557.033935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365824 00000100:00100000:2.0:1789601557.033949:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365824 00000100:00100000:2.0:1789601557.034023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:2.0:1789601557.034033:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11426:x1876532898365824:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601557.034098:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601557.034135:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1e78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c71 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.034157:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:2.0:1789601557.034163:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601557.034196:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.034215:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.034240:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601557.034414:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fca1e542 reply state 00000000dee7fce3 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.034429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.034435:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:2.0:1789601557.034438:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601557.034441:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601557.034634:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+17:11426:x1876532898365824:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 600us (835us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789601557.034642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:0.0:1789601557.037205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601557.037393:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898365952 00000100:00100000:1.0:1789601557.037406:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898365952 00000100:00100000:1.0:1789601557.037514:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789601557.037527:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898365952:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789601557.038006:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789601557.038012:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789601556 -> 1789601556 00002000:00010000:1.0:1789601557.038015:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789601556 00002000:00010000:1.0:1789601557.038018:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789601556 -> 1789601556 00002000:00010000:1.0:1789601557.038021:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789601557.038193:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898365952:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 667us (999us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789601557.038202:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1789601557.041453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601557.041603:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366208 00000100:00100000:2.0:1789601557.041615:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366208 00000100:00100000:2.0:1789601557.041683:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:2.0:1789601557.041695:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+17:11426:x1876532898366208:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789601557.041808:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.041841:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.041854:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.041910:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 17 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.041946:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 17 pid: 9040 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601557.041967:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918367232:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601557.042084:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601557.046815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.047268:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366336 00000100:00100000:3.0:1789601557.047281:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366336 00010000:00010000:3.0:1789601557.047355:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 18 pid: 9040 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601557.047405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1789601557.047417:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:2415:x1876532898366336:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601557.047437:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601557.047461:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 18 pid: 9040 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.047487:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 18 pid: 9040 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.047516:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:3.0:1789601557.047522:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.047534:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.047543:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.047608:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601557.047672:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:2415:x1876532898366336:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 257us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.047680:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00010000:00010000:1.0:1789601557.049776:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1e5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c63 expref: 17 pid: 9040 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.049812:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918367232:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601557.049855:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050061:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050070:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050135:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050143:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050180:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050186:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601557.050192:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050201:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050221:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:1.0:1789601557.050225:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789601557.050231:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.050237:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1ea2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.050654:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:11426:x1876532898366208:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 8957us (9218us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789601557.050667:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:2.0:1789601557.058050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601557.058412:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366464 00000100:00100000:1.0:1789601557.058427:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366464 00000100:00100000:1.0:1789601557.058547:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:1.0:1789601557.058711:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898366464:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789601557.058962:0:8857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.058991:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.059020:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601557.059025:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601557.059031:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.059078:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.059096:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 7 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.059240:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918367360:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601557.059477:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601557.065010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601557.065130:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366592 00000100:00100000:0.0:1789601557.065140:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366592 00010000:00010000:0.0:1789601557.065201:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 8 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.065252:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:0.0:1789601557.065263:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898366592:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601557.065283:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601557.065310:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 8 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.065343:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 8 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.065373:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bfef9c1/0x74872e3eca9f1e86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c7f expref: 8 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.065393:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601557.065399:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601557.065406:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.065419:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.065465:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601557.065552:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898366592:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 290us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.065596:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1789601557.066007:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5485880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918367360:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601557.066043:0:8857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066057:0:8857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066067:0:8857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066097:0:8857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066116:0:8857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066125:0:8857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066135:0:8857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601557.066141:0:8857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066164:0:8857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066183:0:8857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.066193:0:8857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2e39d8/0x74872e3eca9f1ea9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.066260:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898366464:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 7702us (8226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601557.066270:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789601557.070032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601557.070279:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366848 00000100:00100000:0.0:1789601557.070292:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366848 00000100:00100000:0.0:1789601557.070380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00100000:0.0:1789601557.070395:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:11426:x1876532898366848:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789601557.070509:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.070530:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.070543:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.070630:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.070648:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 16 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.070666:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c280b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918367488:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601557.070785:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d1057180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601557.074437:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c280b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918367488:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601557.074496:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.080954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.081128:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898366976 00000100:00100000:3.0:1789601557.081142:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898366976 00010000:00010000:3.0:1789601557.081206:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 17 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601557.081263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:3.0:1789601557.081276:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+17:2416:x1876532898366976:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601557.081297:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601557.081331:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 17 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081349:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 17 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081383:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f1d9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c2b expref: 17 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081408:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601557.081417:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081430:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081440:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081451:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.081495:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601557.081611:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:2416:x1876532898366976:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 338us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.081620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00010000:00010000:2.0:1789601557.082106:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082118:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082402:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082412:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082462:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.082477:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 16 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601557.082509:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5482680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918367616:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601557.082896:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601557.095280:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601557.095494:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5482680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918367616:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601557.095533:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.096018:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898367104 00000100:00100000:0.0:1789601557.096027:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898367104 00010000:00010000:0.0:1789601557.096079:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 17 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.096135:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:0.0:1789601557.096156:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+17:2415:x1876532898367104:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601557.096176:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601557.096184:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 17 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096198:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 17 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096226:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1e6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c6a expref: 17 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096245:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:0.0:1789601557.096251:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096262:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096272:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601557.096424:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601557.096498:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:2415:x1876532898367104:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 352us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.096507:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00010000:00010000:3.0:1789601557.098521:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.098543:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601557.100001:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789601557.100307:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789601557.100427:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789601557.100717:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5482680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918367744:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789601557.100996:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601557.101088:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c30aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601557.103648:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918367744 00000100:00100000:0.0:1789601557.103668:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918367744 00000100:00100000:0.0:1789601557.103756:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789601557.103781:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918367744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789601557.103984:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918367744:12345-0@lo:1000:mdt00_000.0 Request processed in 215us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.103992:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789601557.104380:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789601557.104404:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1789601557.104429:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4fbc4df80, transno 4294967310 00000004:00080000:1.0:1789601557.104448:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4d015b480, transno 4294967311 00000100:00100000:1.0:1789601557.104457:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5482680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918367744:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789601557.104695:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789601557.104811:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918367872:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789601557.105229:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601557.105272:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601557.105596:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918367872 00000100:00100000:3.0:1789601557.105605:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918367872 00000100:00100000:3.0:1789601557.105655:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789601557.105665:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876532918367872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789601557.105827:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876532918367872:12345-0@lo:1000:mdt00_000.0 Request processed in 164us (600us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789601557.105846:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789601557.106069:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5487480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876532918367872:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789601557.106121:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106132:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106140:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106147:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601557.106403:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106414:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106433:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:1.0:1789601557.106437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601557.106443:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f1eb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106500:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106506:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106512:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106517:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601557.106521:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106527:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106536:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601557.106539:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601557.106546:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106605:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106617:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.106666:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.106681:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918368000:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789601557.106767:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601557.110600:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.110696:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898367232 00000100:00100000:3.0:1789601557.110710:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898367232 00000100:00100000:0.0:1789601557.111059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1789601557.111074:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+20:11425:x1876532898367232:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:0.0:1789601557.111253:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+20:11425:x1876532898367232:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 183us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.111261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789601557.112917:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918368000:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789601557.112961:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.112975:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1dfa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113023:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113044:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113058:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113072:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113079:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113087:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113127:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601557.113132:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113141:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113167:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601557.113171:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601557.113176:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1ebe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113195:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113202:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113208:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113214:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601557.113218:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113225:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601557.113249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601557.113253:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.113259:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f1eb0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601557.113498:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+19:11426:x1876532898366848:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 43105us (43481us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789601557.113509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 139 00000020:00080000:1.0:1789601557.113516:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789601557.114599:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601557.114609:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601557.115216:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789601557.115228:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601557.119035:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.119451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898367488 00000100:00100000:3.0:1789601557.119467:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898367488 00000100:00100000:3.0:1789601557.119724:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1789601557.119744:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0980c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+19:11426:x1876532898367488:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789601557.120142:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789601557.120183:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789601557.120237:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120259:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120275:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120305:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120313:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120331:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.120363:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601557.120493:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0980c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:11426:x1876532898367488:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 754us (1472us total) trans 4294967410 rc 0/0 00010000:00010000:1.0:1789601557.120589:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601557.120598:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.120606:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601557.120611:0:7464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.120621:0:7464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.120636:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:1.0:1789601557.120639:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601557.120646:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.120653:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ec5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601557.120679:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601557.120681:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601557.120683:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601557.125704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000020:00080000:3.0:1789601557.125721:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789601557.126235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601557.126432:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898367744 00000100:00100000:1.0:1789601557.126445:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898367744 00000100:00100000:1.0:1789601557.126518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:1.0:1789601557.126531:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+21:11425:x1876532898367744:12345-192.168.203.48@tcp:58:lfs.0 00000040:00080000:1.0:1789601557.126844:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789601557.126960:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c280b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+21:11425:x1876532898367744:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 432us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601557.126969:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 140 00010000:00010000:1.0:1789601557.130608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601557.156697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.156871:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898367872 00000100:00100000:3.0:1789601557.156887:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898367872 00000100:00100000:3.0:1789601557.156964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:3.0:1789601557.156975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:11428:x1876532898367872:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601557.157006:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601557.157032:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1ecc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c86 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157113:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157131:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157145:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157180:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157194:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157293:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157304:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157313:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157368:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.157384:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 22 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601557.157401:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918368128:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601557.157513:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601557.161107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601557.161254:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918368128:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601557.161291:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601557.162276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898368128 00000100:00100000:0.0:1789601557.162288:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898368128 00000100:00100000:1.0:1789601557.162812:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1789601557.162829:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+23:6187:x1876532898368128:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789601557.163172:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:6187:x1876532898368128:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 346us (2078us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789601557.163181:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1789601557.167103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601557.167299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898368256 00000100:00100000:3.0:1789601557.167311:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898368256 00010000:00010000:3.0:1789601557.167394:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 24 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601557.167490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789601557.167504:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:2415:x1876532898368256:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601557.167524:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601557.167533:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 24 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167548:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 24 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167599:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1dec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c47 expref: 24 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167620:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601557.167627:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167638:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167647:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601557.167685:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601557.167754:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+23:2415:x1876532898368256:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 253us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.167762:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00010000:00010000:2.0:1789601557.167849:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.167859:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601557.167938:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789601557.167945:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601557.167972:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.167999:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168011:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168018:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168026:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168031:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.168036:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168044:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168055:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:2.0:1789601557.168058:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.168063:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168070:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1ed3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168083:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168089:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168102:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168107:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601557.168111:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168118:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168126:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df4e0d94700) 00010000:00010000:2.0:1789601557.168129:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601557.168132:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168138:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1eda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168198:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1ecc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c86 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168214:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c86 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601557.168222:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:2.0:1789601557.168224:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601557.168227:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528400, rc 0) 00000100:00100000:2.0:1789601557.168256:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+22:11428:x1876532898367872:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 11283us (11578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601557.168271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000001:00080000:2.0:1789601557.710335:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789601557.710361:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789601557.832338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918368256:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.832503:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918368768:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832534:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601557.832570:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368256 00000100:00100000:3.0:1789601557.832579:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918369280:0@lo:400:kworker.0 00000100:00100000:2.0:1789601557.832581:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368256 00000100:00100000:3.0:1789601557.832606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.832631:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601557.832637:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918368640:0@lo:400:kworker.0 00000100:00100000:2.0:1789601557.832638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789601557.832649:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918368256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832656:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.832673:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918369152:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832697:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601557.832706:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918368256:12345-0@lo:400:kworker.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601557.832714:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789601557.832726:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918368256:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918368512:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.832779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.832805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918369024:0@lo:400:kworker.0 00000100:00100000:2.0:1789601557.832825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368768 00000100:00100000:2.0:1789601557.832830:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368768 00000100:00100000:2.0:1789601557.832856:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368512 00000100:00100000:2.0:1789601557.832859:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368512 00000100:00100000:2.0:1789601557.832875:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789601557.832881:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918368768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601557.832925:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918368768:12345-0@lo:400:kworker.0 Request processed in 44us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601557.832931:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789601557.832943:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789601557.832948:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918368512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601557.832973:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918368512:12345-0@lo:400:kworker.0 Request processed in 25us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601557.832979:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789601557.833006:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918368768:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.836360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.836438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918369536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.836507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4e0f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918368384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.836510:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.836607:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918368512:0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.836624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.836658:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369280 00000100:00100000:3.0:1789601557.836667:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369280 00000100:00100000:0.0:1789601557.836668:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918368896:0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.836699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.836733:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368640 00000100:00100000:0.0:1789601557.836736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918369408:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.836739:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368640 00000100:00100000:3.0:1789601557.836760:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369024 00000100:00100000:3.0:1789601557.836765:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369024 00000100:00100000:0.0:1789601557.836773:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601557.836791:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368384 00000100:00100000:3.0:1789601557.836795:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368384 00000100:00100000:3.0:1789601557.836808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918368896 00000100:00100000:3.0:1789601557.836811:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918368896 00000100:00100000:3.0:1789601557.836840:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789601557.836849:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918369280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.836925:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369408 00000100:00100000:0.0:1789601557.836930:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369408 00000100:00100000:0.0:1789601557.836956:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789601557.836963:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918368640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.837096:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918369280:12345-0@lo:400:kworker.0 Request processed in 247us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.837104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789601557.837143:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918368640:12345-0@lo:400:kworker.0 Request processed in 179us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.837151:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789601557.837171:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789601557.837178:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918369024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.837215:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918369024:12345-0@lo:400:kworker.0 Request processed in 37us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.837221:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789601557.837240:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789601557.837247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789601557.837251:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918368384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.837262:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918368896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.837308:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918368384:12345-0@lo:400:kworker.0 Request processed in 60us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.837320:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918368896:12345-0@lo:400:kworker.0 Request processed in 53us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.837329:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789601557.837336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789601557.837348:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789601557.837358:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.837370:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369152 00000100:00100000:3.0:1789601557.837376:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369152 00000100:00100000:0.0:1789601557.837392:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918369408:12345-0@lo:400:kworker.0 Request processed in 36us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601557.837400:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789601557.837415:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369536 00000100:00100000:3.0:1789601557.837420:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369536 00000100:00100000:0.0:1789601557.837444:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4e0f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918368384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.837452:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601557.837463:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918369152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601557.837475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918368896:0@lo:400:kworker.0 00010000:00080000:0.0:1789601557.837489:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4060000 x1876532918369408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601557.837501:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918369408:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.837513:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918369152:12345-0@lo:400:kworker.0 Request processed in 51us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.837522:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601557.837540:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789601557.837548:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.838461:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918369536:12345-0@lo:400:kworker.0 Request processed in 911us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601557.838486:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789601557.838519:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601557.838525:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601557.838529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601557.838532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601557.840384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918368640:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.840419:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918369152:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.840432:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918369280:0@lo:400:kworker.0 00010000:00080000:3.0:1789601557.840504:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4063800 x1876532918369024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601557.840517:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918369024:0@lo:400:kworker.0 00000100:00100000:3.0:1789601557.840530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918369536:0@lo:400:kworker.0 00010000:00010000:3.0:1789601558.149866:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601558.150106:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601558.150120:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601558.150163:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789601558.150172:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601558.150347:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5482d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918369664:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601558.150471:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9b549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601558.156195:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5482d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918369664:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601558.158090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601558.158169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898368384 00000100:00100000:3.0:1789601558.158181:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898368384 00000100:00100000:3.0:1789601558.158260:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:3.0:1789601558.158272:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:11440:x1876532898368384:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601558.158328:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601558.158532:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:11440:x1876532898368384:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 261us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601558.158540:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:1.0:1789601558.170148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601558.184630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898368640 00000100:00100000:0.0:1789601558.184651:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898368640 00000100:00100000:1.0:1789601558.188301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:1.0:1789601558.190768:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+22:11440:x1876532898368640:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601558.190803:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601558.190942:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1ee8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c8d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.191113:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f1eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.191132:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f1eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.191147:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f1eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601558.191161:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789601558.191304:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1ee8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c8d expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.191336:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f1eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c8d expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.191345:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601558.191348:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601558.191355:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e0e00, rc 0) 00000100:00100000:1.0:1789601558.191446:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+24:11440:x1876532898368640:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 709us (21312us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789601558.191456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:1.0:1789601558.200437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601558.201104:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898368768 00000100:00100000:3.0:1789601558.201136:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898368768 00000100:00100000:3.0:1789601558.201225:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789601558.201239:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+24:2417:x1876532898368768:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601558.201260:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601558.201295:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f1eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c8d expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601558.201329:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:3.0:1789601558.201336:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601558.201406:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+23:2417:x1876532898368768:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 170us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601558.201415:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789601558.219888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601558.220204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369024 00000100:00100000:1.0:1789601558.220218:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369024 00000100:00100000:1.0:1789601558.220294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:1.0:1789601558.220305:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+23:11440:x1876532898369024:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789601558.220435:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220455:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220471:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220689:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220699:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220707:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220714:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601558.220720:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220729:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220744:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601558.220747:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601558.220753:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.220760:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1efd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601558.220915:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+24:11440:x1876532898369024:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 611us (1038us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789601558.220924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00000040:00080000:1.0:1789601558.221035:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601558.221041:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601558.221635:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789601558.221643:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601558.247460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000040:00080000:2.0:1789601558.255109:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601558.255122:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601558.255158:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789601558.255165:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601558.256468:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369280 00000100:00100000:0.0:1789601558.256481:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369280 00000100:00100000:0.0:1789601558.256578:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:0.0:1789601558.256590:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+24:11440:x1876532898369280:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601558.256883:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+25:11440:x1876532898369280:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 294us (9439us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789601558.256892:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789601558.342905:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918369792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601558.343004:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601558.343110:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369792 00000100:00100000:3.0:1789601558.343120:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369792 00000100:00100000:3.0:1789601558.343177:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789601558.343188:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918369792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601558.343227:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601558.343281:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918369792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601558.343290:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789601558.343380:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918369792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601558.356493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918369920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601558.356630:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601558.366793:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918369920 00000100:00100000:2.0:1789601558.366815:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918369920 00000100:00100000:2.0:1789601558.366902:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789601558.366915:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918369920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601558.366947:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601558.367053:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918369920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (10423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601558.367060:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789601558.367128:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789601558.367137:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000100:00080000:0.0:1789601558.367223:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789601558.368630:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4d0158380, transno 4294967302 00000004:00080000:2.0:1789601558.368651:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789601558.368667:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4cd0b9c00, transno 4294967305 00000100:00100000:2.0:1789601558.368692:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918369920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601558.498271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601558.502753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369536 00000100:00100000:2.0:1789601558.502776:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369536 00000100:00100000:2.0:1789601558.502915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:2.0:1789601558.502927:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+25:11453:x1876532898369536:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601558.502971:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601558.502998:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c94 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601558.503142:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1f0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601558.503159:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1f0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601558.503173:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1f0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601558.503186:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789601558.503339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f1f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c94 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601558.503357:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1f0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c94 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601558.503367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:2.0:1789601558.503370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789601558.503375:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382c00, rc 0) 00000100:00100000:2.0:1789601558.503477:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+27:11453:x1876532898369536:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 552us (5223us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789601558.503485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:0.0:1789601558.514438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601558.514530:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369664 00000100:00100000:1.0:1789601558.514545:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369664 00000100:00100000:1.0:1789601558.514649:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:1.0:1789601558.514662:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+27:11453:x1876532898369664:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789601558.514753:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514777:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514792:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514838:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514847:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514927:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514944:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601558.514949:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514959:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514976:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601558.514979:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601558.514987:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.514994:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1e00/0x74872e3eca9f1f19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601558.515090:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+27:11453:x1876532898369664:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 429us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601558.515099:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:0.0:1789601558.653217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601558.653379:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369792 00000100:00100000:3.0:1789601558.653393:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369792 00000100:00080000:0.0:1789601558.653484:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601558.653546:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:1.0:1789601558.653597:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898369792:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:1.0:1789601558.653622:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601558.653648:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa65020/0x74872e3eca9f1f20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48c9b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601558.653679:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab2714, atime: 0x6aab2714, ctime: 0x6aab2714, blocks: 0x8 00010000:00010000:1.0:1789601558.653703:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1789601558.653708:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601558.653724:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa65020/0x74872e3eca9f1f20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c9b expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.653749:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baa65020/0x74872e3eca9f1f20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c9b expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601558.653764:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1e00, rc 0) 00000100:00100000:1.0:1789601558.653823:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4fbc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2417:x1876532898369792:12345-192.168.203.48@tcp:101:cat.0 Request processed in 266us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601558.653830:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1789601558.662187:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601558.664872:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898369920 00000100:00100000:2.0:1789601558.664893:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898369920 00002000:00100000:2.0:1789601558.664975:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8df3c318d180 x1876532898369920/t0(0) o3->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1789601569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601558.665004:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c318d180 with x1876532898369920 ext(0->4095) 00002000:00010000:2.0:1789601558.669060:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c318d180 00000100:00100000:2.0:1789601558.669136:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601558.669172:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898369920:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:2.0:1789601558.669480:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898369920:12345-192.168.203.48@tcp:3:cat.0 Request processed in 334us (7311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789601558.669489:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:2.0:1789601558.669500:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8df3c318d180 x1876532898369920/t0(0) o3->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1789601569 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601558.669512:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c318d180 with x1876532898369920 ext(0->4095) 00002000:00010000:2.0:1789601558.669518:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c318d180 00010000:00010000:1.0:1789601559.173863:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601559.331397:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601559.331466:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601559.331494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601559.331514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601559.331588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601559.331637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370560 00000100:00100000:0.0:1789601559.331649:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370560 00000100:00100000:0.0:1789601559.331715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370176 00000100:00100000:0.0:1789601559.331719:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370176 00000100:00100000:0.0:1789601559.331735:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370432 00000100:00100000:0.0:1789601559.331737:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370432 00000100:00100000:0.0:1789601559.331757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 316 00000100:00100000:0.0:1789601559.331770:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898370560:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601559.331863:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898370560:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601559.331872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 316 00000100:00100000:0.0:1789601559.331893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 317 00000100:00100000:0.0:1789601559.331900:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898370176:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601559.331926:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898370176:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601559.331933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 317 00000100:00100000:0.0:1789601559.331945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 318 00000100:00100000:0.0:1789601559.331951:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898370432:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601559.331973:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898370432:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601559.331979:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 318 00000100:00080000:0.0:1789601559.332000:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601559.332004:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601559.332517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370048 00000100:00100000:3.0:1789601559.332523:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370048 00000100:00100000:3.0:1789601559.332580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 388 00000100:00100000:3.0:1789601559.332588:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898370048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601559.332635:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898370048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 48us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601559.332642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 388 00000100:00100000:3.0:1789601559.332677:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370304 00000100:00100000:3.0:1789601559.332680:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370304 00000100:00100000:3.0:1789601559.332714:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:3.0:1789601559.332721:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898370304:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601559.332751:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898370304:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601559.332756:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00080000:3.0:1789601559.332783:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601559.884009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918370048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601559.884175:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601559.884632:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370048 00000100:00100000:1.0:1789601559.884642:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370048 00000100:00100000:1.0:1789601559.884710:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789601559.884723:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918370048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601559.884763:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789601559.885672:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918370048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 945us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601559.885684:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1789601559.885722:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601559.886584:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918370048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601559.887466:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601559.887485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918370176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601559.887603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601559.887722:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370176 00000100:00100000:1.0:1789601559.887732:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370176 00000100:00100000:1.0:1789601559.887803:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789601559.888172:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f9e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918370176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601559.888213:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789601559.888282:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f9e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918370176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 470us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601559.888290:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789601559.888352:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601559.890023:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918370176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789601560.208739:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601560.902135:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918370304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601560.902233:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601560.902595:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370304 00000100:00100000:0.0:1789601560.902608:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370304 00000100:00100000:0.0:1789601560.902674:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789601560.902685:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918370304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601560.902757:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601560.902823:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918370304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601560.902832:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789601560.903216:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918370304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601561.228276:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601561.415671:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918370432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601561.415773:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601561.416019:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370432 00000100:00100000:0.0:1789601561.416031:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370432 00000100:00100000:0.0:1789601561.416098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789601561.416109:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918370432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601561.416164:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789601561.416222:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918370432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601561.416230:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789601561.421169:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918370432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789601562.245843:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601562.309928:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601562.309940:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601562.309964:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789601562.309977:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789601562.566411:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1789601562.952273:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789601562.952339:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4f73a03c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789601562.952345:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4c727d000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4f73a0000 00000020:00080000:1.0:1789601562.952349:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4c727d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df4c12e7000 00000020:00080000:1.0:1789601562.952373:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789601562.952386:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789601562.952493:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1789601562.952751:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952767:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952778:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952785:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601562.952800:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952810:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952835:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df4f8af9e00) 00010000:00010000:0.0:1789601562.952856:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601562.952864:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601562.952871:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f1e9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601562.953267:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789601562.953291:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:3.0:1789601562.954724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918370560:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.954852:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.954918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918371072:0@lo:400:kworker.0 00000100:00100000:1.0:1789601562.954922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918370944:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.954956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601562.954956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601562.954977:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918371456:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.954978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918371584:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955001:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.955021:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955049:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.955070:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789601562.955076:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918370688:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955097:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.955114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918371200:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955135:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.955151:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918371712:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955179:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.955212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370560 00000100:00100000:3.0:1789601562.955223:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370560 00000100:00100000:3.0:1789601562.955302:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789601562.955312:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918370560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955372:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918370560:12345-0@lo:400:kworker.0 Request processed in 60us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789601562.955418:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371072 00000100:00100000:3.0:1789601562.955423:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371072 00000100:00100000:3.0:1789601562.955453:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789601562.955470:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955506:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918371072:12345-0@lo:400:kworker.0 Request processed in 47us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955520:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789601562.955538:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371584 00000100:00100000:3.0:1789601562.955541:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371584 00000100:00100000:3.0:1789601562.955600:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372096 00000100:00100000:3.0:1789601562.955603:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372096 00000100:00100000:3.0:1789601562.955627:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789601562.955634:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918371584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955668:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918371584:12345-0@lo:400:kworker.0 Request processed in 35us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955673:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789601562.955684:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789601562.955690:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955713:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372096:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955719:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789601562.955742:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370944 00000100:00100000:3.0:1789601562.955745:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370944 00000100:00100000:3.0:1789601562.955765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370688 00000100:00100000:3.0:1789601562.955768:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370688 00000100:00100000:3.0:1789601562.955779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371200 00000100:00100000:3.0:1789601562.955782:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371200 00000100:00100000:3.0:1789601562.955797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371712 00000100:00100000:3.0:1789601562.955799:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371712 00000100:00100000:3.0:1789601562.955813:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789601562.955818:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918370944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955850:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c35a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918370944:12345-0@lo:400:kworker.0 Request processed in 32us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789601562.955877:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789601562.955883:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918370688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955912:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918370688:12345-0@lo:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789601562.955929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789601562.955935:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918371200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.955959:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918371200:12345-0@lo:400:kworker.0 Request processed in 25us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.955965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789601562.955975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789601562.955979:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956006:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918371712:12345-0@lo:400:kworker.0 Request processed in 26us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956012:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1789601562.956046:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601562.956051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601562.956054:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601562.956073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.956098:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918371968:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956122:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.956166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918370944:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789601562.956193:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918370816:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.956237:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918371328:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956267:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.956301:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918371840:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956323:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601562.956347:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918370816 00000100:00100000:3.0:1789601562.956351:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918370816 00000100:00100000:3.0:1789601562.956374:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789601562.956379:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918370816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956414:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918370816:12345-0@lo:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956420:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789601562.956436:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371456 00000100:00100000:3.0:1789601562.956440:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371456 00000100:00100000:3.0:1789601562.956464:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371968 00000100:00100000:3.0:1789601562.956467:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371968 00000100:00100000:3.0:1789601562.956484:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789601562.956489:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918371456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956522:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918371456:12345-0@lo:400:kworker.0 Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956528:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789601562.956540:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789601562.956546:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918371968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956599:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918371968:12345-0@lo:400:kworker.0 Request processed in 54us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956606:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789601562.956627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371328 00000100:00100000:3.0:1789601562.956630:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371328 00000100:00100000:3.0:1789601562.956652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918371840 00000100:00100000:3.0:1789601562.956660:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918371840 00000100:00100000:3.0:1789601562.956679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789601562.956685:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918371328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956716:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918371328:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789601562.956733:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789601562.956738:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918371840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956764:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918371840:12345-0@lo:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601562.956769:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1789601562.956785:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601562.956788:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601562.956791:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601562.956821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918370816:0@lo:400:kworker.0 00010000:00080000:3.0:1789601562.956834:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4064700 x1876532918371328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601562.956846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918371328:0@lo:400:kworker.0 00010000:00080000:3.0:1789601562.956856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4065880 x1876532918371840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601562.956864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918371840:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918371456:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956885:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918371968:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918370688:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956950:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918371200:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918371712:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918371072:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918371584:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.956994:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789601562.957000:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789601562.957018:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601562.957028:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918370560:0@lo:400:kworker.0 00010000:00010000:1.0:1789601563.291858:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601563.462761:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918372224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601563.462873:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601563.463119:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372224 00000100:00100000:2.0:1789601563.463131:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372224 00000100:00100000:2.0:1789601563.463194:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789601563.463206:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918372224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601563.463243:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601563.463521:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601563.463536:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601563.463636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601563.465803:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918372224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2586us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601563.465819:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789601563.465859:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372352 00000100:00100000:2.0:1789601563.465868:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372352 00000100:00100000:3.0:1789601563.465985:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789601563.466001:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918372352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601563.466030:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601563.466165:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918372352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601563.466172:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789601563.467962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918372224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601563.468634:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c31b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601563.956135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601563.962650:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370688 00000100:00100000:2.0:1789601563.962671:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370688 00000100:00100000:2.0:1789601563.962774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:2.0:1789601563.962789:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11114:x1876532898370688:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789601563.962951:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11114:x1876532898370688:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 166us (6829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601563.962959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00080000:1.0:1789601563.963065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601563.979221:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601563.981527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898370816 00000100:00100000:3.0:1789601563.981550:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898370816 00000100:00100000:3.0:1789601563.981678:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:3.0:1789601563.981695:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:11114:x1876532898370816:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1789601563.981886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601563.982322:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c31b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+5:11114:x1876532898370816:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 629us (3112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601563.982332:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:2.0:1789601563.995014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601563.995148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371072 00000100:00100000:3.0:1789601563.995161:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371072 00000100:00100000:3.0:1789601563.995235:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789601563.995248:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:11114:x1876532898371072:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789601563.995594:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+14:11114:x1876532898371072:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 348us (594us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789601563.995603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00010000:00010000:1.0:1789601564.296352:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601564.452245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601564.452309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601564.452386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371328 00000100:00100000:3.0:1789601564.452401:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371328 00000100:00100000:2.0:1789601564.452404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601564.452470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601564.452485:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371840 00000100:00100000:3.0:1789601564.452489:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371840 00000100:00100000:2.0:1789601564.452510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601564.452582:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601564.454253:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371456 00000100:00100000:3.0:1789601564.454276:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371456 00000100:00100000:3.0:1789601564.454322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 325 00000100:00100000:3.0:1789601564.454335:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+14:2415:x1876532898371328:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601564.454457:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+14:2415:x1876532898371328:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 124us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601564.454465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 325 00000100:00100000:3.0:1789601564.454933:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 326 00000100:00100000:3.0:1789601564.454943:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898371840:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601564.454980:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898371840:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601564.454987:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 326 00000100:00100000:3.0:1789601564.455000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 327 00000100:00100000:3.0:1789601564.455006:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898371456:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601564.456442:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898371456:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1426us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601564.456454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 327 00000100:00080000:3.0:1789601564.456750:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601564.456916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371200 00000100:00100000:3.0:1789601564.456926:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371200 00000100:00100000:3.0:1789601564.456974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 390 00000100:00100000:3.0:1789601564.456982:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898371200:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601564.457021:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2415:x1876532898371200:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601564.457027:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 390 00000100:00100000:2.0:1789601564.459823:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601564.460619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371968 00000100:00100000:1.0:1789601564.460634:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371968 00000100:00100000:1.0:1789601564.460732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 328 00000100:00100000:1.0:1789601564.460746:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898371968:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601564.460850:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898371968:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 108us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601564.460858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 328 00000100:00080000:2.0:1789601564.463029:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601564.476684:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371584 00000100:00100000:0.0:1789601564.476715:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371584 00000100:00100000:0.0:1789601564.476863:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898371712 00000100:00100000:0.0:1789601564.476868:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898371712 00000100:00100000:0.0:1789601564.476914:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:0.0:1789601564.476928:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898371584:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601564.477051:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898371584:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 126us (24741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601564.477060:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:0.0:1789601564.477080:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:0.0:1789601564.477087:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898371712:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601564.477111:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898371712:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (24565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601564.477117:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00080000:2.0:1789601564.477601:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601564.477607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601564.998859:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601564.998894:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918372480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601564.999008:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601564.999470:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601564.999504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601564.999723:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372480 00000100:00100000:2.0:1789601564.999734:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372480 00000100:00100000:2.0:1789601564.999808:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372608 00000100:00100000:2.0:1789601564.999811:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372608 00000100:00100000:2.0:1789601564.999828:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789601564.999837:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918372480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601564.999882:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789601564.999943:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918372480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601564.999951:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789601564.999972:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601564.999978:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601564.999987:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789601565.000012:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601565.000018:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601565.000062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601565.000217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918372480:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789601565.000639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601565.319106:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601566.022764:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601566.022797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601566.022892:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601566.023025:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372736 00000100:00100000:1.0:1789601566.023037:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372736 00000100:00100000:1.0:1789601566.023104:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601566.023116:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601566.023161:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601566.023218:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918372736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601566.023226:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789601566.023336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918372736:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789601566.071330:0:14463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:32:44 (1789601564) 00010000:00010000:1.0:1789601566.341840:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601566.534601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918372864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601566.534672:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601566.538381:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372864 00000100:00100000:0.0:1789601566.538398:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372864 00000100:00100000:0.0:1789601566.538638:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789601566.538653:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918372864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601566.538694:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789601566.538940:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918372864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 290us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601566.538948:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789601566.539235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918372864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601567.209083:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601567.209342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372224 00000100:00100000:3.0:1789601567.209352:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372224 00000100:00100000:3.0:1789601567.209461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:3.0:1789601567.209471:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+14:12170:x1876532898372224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601567.209490:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601567.209508:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ca2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209605:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209619:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209632:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209664:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209698:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209706:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209796:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209806:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.209813:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601567.209822:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789601567.210467:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210477:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210484:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210489:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601567.210493:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210512:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210524:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df4f5eb2900) 00010000:00010000:3.0:1789601567.210528:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601567.210533:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210539:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210631:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210639:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210645:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210650:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601567.210653:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210659:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210666:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df4e0d94600) 00010000:00010000:3.0:1789601567.210669:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601567.210672:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.210688:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f35 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.213571:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ca2 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.213600:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ca2 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.213608:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:3.0:1789601567.213612:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601567.213615:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528200, rc 0) 00000100:00100000:3.0:1789601567.213693:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+16:12170:x1876532898372224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 4221us (4618us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789601567.213702:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00080000:0.0:1789601567.215382:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601567.222542:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601567.222681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601567.222768:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372480 00000100:00100000:3.0:1789601567.222778:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372480 00000100:00100000:3.0:1789601567.222863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601567.222873:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3639850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+16:2418:x1876532898372480:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601567.222889:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601567.222914:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ca2 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601567.223070:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:3.0:1789601567.223078:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601567.223127:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3639850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:2418:x1876532898372480:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601567.223151:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789601567.223796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372352 00000100:00100000:1.0:1789601567.223805:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372352 00000100:00100000:1.0:1789601567.223959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:1.0:1789601567.223968:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+15:12170:x1876532898372352:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789601567.224094:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+15:12170:x1876532898372352:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 128us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601567.224111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:0.0:1789601567.227071:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601567.230675:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372608 00000100:00100000:1.0:1789601567.230691:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372608 00000100:00100000:1.0:1789601567.230862:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:1.0:1789601567.230875:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:12170:x1876532898372608:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789601567.230991:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:12170:x1876532898372608:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 118us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601567.230998:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00080000:0.0:1789601567.234381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789601567.365859:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601567.430819:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601567.430832:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601567.431340:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789601567.431355:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789601567.686334:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601568.072541:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918372992:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072638:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918373504:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072714:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918374016:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072757:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918374528:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072794:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789601568.072823:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918373376:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072850:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918373888:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072888:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072900:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918374400:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072918:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.072946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918373120:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.072969:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073044:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918373632:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918374144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073116:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789601568.073136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918373248:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073159:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073176:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918373760:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073198:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918374272:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.073260:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918372992 00000100:00100000:3.0:1789601568.073268:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918372992 00000100:00100000:3.0:1789601568.073310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789601568.073319:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918372992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073368:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3646:x1876532918372992:12345-0@lo:400:kworker.0 Request processed in 50us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789601568.073407:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373504 00000100:00100000:3.0:1789601568.073411:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373504 00000100:00100000:3.0:1789601568.073435:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373248 00000100:00100000:3.0:1789601568.073438:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373248 00000100:00100000:3.0:1789601568.073453:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789601568.073458:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918373504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073490:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918373504:12345-0@lo:400:kworker.0 Request processed in 31us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789601568.073507:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789601568.073512:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918373248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073542:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918373248:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073578:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789601568.073597:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374016 00000100:00100000:3.0:1789601568.073601:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374016 00000100:00100000:3.0:1789601568.073631:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374528 00000100:00100000:3.0:1789601568.073634:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374528 00000100:00100000:3.0:1789601568.073647:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373888 00000100:00100000:3.0:1789601568.073650:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373888 00000100:00100000:3.0:1789601568.073661:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374400 00000100:00100000:3.0:1789601568.073663:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374400 00000100:00100000:3.0:1789601568.073674:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601568.073680:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918374016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073712:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918374016:12345-0@lo:400:kworker.0 Request processed in 33us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073718:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601568.073731:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601568.073737:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918374528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073764:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918374528:12345-0@lo:400:kworker.0 Request processed in 28us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073770:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601568.073781:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601568.073787:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918373888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073813:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918373888:12345-0@lo:400:kworker.0 Request processed in 27us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073818:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601568.073829:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601568.073834:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918374400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.073869:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918374400:12345-0@lo:400:kworker.0 Request processed in 35us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.073874:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601568.073896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373376 00000100:00100000:3.0:1789601568.073899:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373376 00000100:00100000:3.0:1789601568.073915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373120 00000100:00100000:3.0:1789601568.073917:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373120 00000100:00100000:3.0:1789601568.073925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373632 00000100:00100000:3.0:1789601568.073927:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373632 00000100:00100000:3.0:1789601568.073936:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374144 00000100:00100000:3.0:1789601568.073939:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374144 00000100:00100000:3.0:1789601568.073947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918373760 00000100:00100000:3.0:1789601568.073949:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918373760 00000100:00100000:3.0:1789601568.073958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374272 00000100:00100000:3.0:1789601568.073960:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374272 00000100:00100000:3.0:1789601568.073970:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789601568.073975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918373376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074004:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918373376:12345-0@lo:400:kworker.0 Request processed in 28us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789601568.074020:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789601568.074025:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918373120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074050:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918373120:12345-0@lo:400:kworker.0 Request processed in 25us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789601568.074066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789601568.074071:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918373632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074098:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918373632:12345-0@lo:400:kworker.0 Request processed in 28us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789601568.074123:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789601568.074128:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918374144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074156:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918374144:12345-0@lo:400:kworker.0 Request processed in 28us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074161:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789601568.074172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789601568.074177:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918373760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074201:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918373760:12345-0@lo:400:kworker.0 Request processed in 24us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789601568.074217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789601568.074222:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918374272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074260:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c23fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918374272:12345-0@lo:400:kworker.0 Request processed in 38us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.074266:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:3.0:1789601568.074305:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601568.074309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601568.074311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601568.074313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601568.074339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918373248:0@lo:400:kworker.0 00010000:00080000:3.0:1789601568.074352:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4065f80 x1876532918373760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601568.074360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918373760:0@lo:400:kworker.0 00010000:00080000:3.0:1789601568.074381:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4064380 x1876532918374272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601568.074388:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918374272:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918373120:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918373632:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074414:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918374144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918373376:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074461:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918373888:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074471:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918374400:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074478:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918372992:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074486:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918373504:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074495:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918374016:0@lo:400:kworker.0 00000100:00100000:3.0:1789601568.074503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918374528:0@lo:400:kworker.0 00010000:00010000:1.0:1789601568.389881:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601568.581989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918374656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601568.582060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601568.582337:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374656 00000100:00100000:2.0:1789601568.582345:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374656 00000100:00100000:2.0:1789601568.582398:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789601568.582407:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918374656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601568.582435:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601568.582487:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918374656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601568.582495:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789601568.582551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918374656:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789601568.590527:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789601568.590547:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789601568.590655:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789601568.590666:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789601568.592285:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601568.592307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c5480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601568.592377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601568.592444:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918374784 00000100:00100000:3.0:1789601568.592452:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918374784 00000100:00100000:3.0:1789601568.592508:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789601568.592517:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918374784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601568.592541:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601568.592618:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918374784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601568.592625:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789601568.596590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c5480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601569.398981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.399056:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372736 00000100:00100000:3.0:1789601569.399066:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372736 00000100:00100000:3.0:1789601569.399185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:3.0:1789601569.399196:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:12213:x1876532898372736:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601569.399236:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601569.399258:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ca9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399328:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399343:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399356:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399371:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399377:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399384:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399440:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399447:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399453:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399459:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.399463:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399470:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399482:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601569.399486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.399490:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399496:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399508:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399528:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399534:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399545:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1529c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.399548:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399587:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df4c3beba00) 00010000:00010000:3.0:1789601569.399590:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.399592:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f1f58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399629:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ca9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399639:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601569.399641:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.399645:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f1f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ca9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.399653:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528200, rc 0) 00000100:00100000:3.0:1789601569.399712:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+13:12213:x1876532898372736:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 519us (741us total) trans 0 rc 301/301 00000100:00100000:3.0:1789601569.399720:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00080000:0.0:1789601569.399777:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601569.410375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.410862:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898372992 00000100:00100000:3.0:1789601569.410893:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898372992 00000100:00100000:3.0:1789601569.410967:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 153 00000100:00100000:3.0:1789601569.410978:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+13:12213:x1876532898372992:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1789601569.411038:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601569.411074:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f18ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ad4 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411098:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4e0d94f00) 00010000:00010000:3.0:1789601569.411111:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601569.411174:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411189:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411684:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411703:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411711:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.411717:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.412720:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.412735:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413267:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601569.413286:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4212d04 reply state 00000000a7fac664 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413298:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413305:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601569.413308:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601569.413312:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601569.413317:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789601569.413326:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413332:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413339:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413345:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.413349:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413355:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413365:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601569.413367:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.413379:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413386:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601569.413408:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4212d04 reply state 00000000a7fac664 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413417:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.413423:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df4c3beb000) 00010000:00010000:3.0:1789601569.413425:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601569.413427:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789601569.413602:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:12213:x1876532898372992:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 2623us (3235us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789601569.413610:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 153 00010000:00010000:1.0:1789601569.415025:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601569.528045:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.529217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373120 00000100:00100000:1.0:1789601569.529238:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373120 00000100:00100000:1.0:1789601569.529311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:1.0:1789601569.529321:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+14:12221:x1876532898373120:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:1.0:1789601569.529346:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601569.529371:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cb0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529439:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529467:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529479:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601569.529529:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789601569.529533:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601569.529600:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529626:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb0 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529646:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb0 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.529654:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:1.0:1789601569.529656:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601569.529660:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1200, rc 0) 00000100:00100000:1.0:1789601569.529726:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+15:12221:x1876532898373120:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 406us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601569.529734:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:1.0:1789601569.581750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.581790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.581828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.581859:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.581879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.581919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.582054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373504 00000100:00100000:0.0:1789601569.582077:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373504 00000100:00100000:0.0:1789601569.582138:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373632 00000100:00100000:0.0:1789601569.582142:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373632 00000100:00100000:0.0:1789601569.582169:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:0.0:1789601569.582179:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898373504:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601569.582287:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898373504:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 109us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.582294:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:0.0:1789601569.582310:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:0.0:1789601569.582317:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898373632:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601569.582340:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2417:x1876532898373632:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.582346:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:3.0:1789601569.582916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373248 00000100:00100000:3.0:1789601569.582923:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373248 00000100:00100000:3.0:1789601569.582960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 392 00000100:00100000:3.0:1789601569.582968:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898373248:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601569.583007:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898373248:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.583014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 392 00000100:00100000:3.0:1789601569.583123:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373760 00000100:00100000:3.0:1789601569.583128:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373760 00000100:00100000:3.0:1789601569.583156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373376 00000100:00100000:3.0:1789601569.583159:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373376 00000100:00100000:3.0:1789601569.583171:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898373888 00000100:00100000:3.0:1789601569.583184:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898373888 00000100:00100000:3.0:1789601569.583216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 335 00000100:00100000:3.0:1789601569.583223:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898373760:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601569.583269:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898373760:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 46us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.583275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 335 00000100:00100000:3.0:1789601569.583288:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 336 00000100:00100000:3.0:1789601569.583294:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898373376:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601569.583319:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898373376:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.583325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 336 00000100:00100000:3.0:1789601569.583337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 337 00000100:00100000:3.0:1789601569.583343:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898373888:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601569.583365:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898373888:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.583370:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 337 00000100:00080000:1.0:1789601569.585056:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601569.585065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601569.585068:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601569.585071:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601569.639434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.639701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374016 00000100:00100000:3.0:1789601569.639712:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374016 00000100:00100000:3.0:1789601569.639782:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:3.0:1789601569.639793:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+15:12227:x1876532898374016:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601569.639813:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601569.639833:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cb7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639893:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639924:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639937:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639951:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639958:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.639964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640045:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640051:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601569.640097:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789601569.640100:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601569.640119:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640130:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640145:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640152:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640158:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.640163:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640169:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640181:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:3.0:1789601569.640184:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.640189:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640374:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f1f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640393:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640399:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640405:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640410:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.640419:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640425:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df4c3beb000) 00010000:00010000:3.0:1789601569.640437:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601569.640440:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f1f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640487:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f1f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb7 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640503:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb7 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.640510:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601569.640512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789601569.640514:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528c00, rc 0) 00000100:00100000:3.0:1789601569.640625:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+16:12227:x1876532898374016:12345-192.168.203.48@tcp:101:bash.0 Request processed in 833us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.640633:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:3.0:1789601569.643869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.643971:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374272 00000100:00100000:0.0:1789601569.643980:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374272 00000100:00100000:0.0:1789601569.644042:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:0.0:1789601569.644052:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+16:12227:x1876532898374272:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601569.644080:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601569.644098:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f1f9e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cbe expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644276:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644291:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644302:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644364:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644387:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.644395:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601569.645081:0:9040:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789601569.645673:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645687:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645696:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645731:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645940:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645950:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645957:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601569.645962:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645970:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.645999:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601569.646002:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601569.646007:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.646013:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f1fa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601569.646029:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8d10e35 reply state 00000000a2683e23 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.646041:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.646046:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:0.0:1789601569.646048:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601569.646052:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789601569.646152:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f1f9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.646168:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 18 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.646175:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:0.0:1789601569.646177:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601569.646179:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467c00, rc 0) 00000100:00100000:0.0:1789601569.646388:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:12227:x1876532898374272:12345-192.168.203.48@tcp:101:bash.0 Request processed in 2334us (2525us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789601569.646398:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:2.0:1789601569.654845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.654941:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374400 00000100:00100000:0.0:1789601569.654951:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374400 00000100:00100000:0.0:1789601569.655041:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789601569.655052:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2415:x1876532898374400:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601569.655140:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601569.655161:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cc5 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601569.655185:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601569.655281:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1789601569.655286:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601569.655297:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.655315:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.655329:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467e00, rc 0) 00000100:00100000:0.0:1789601569.655388:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898374400:12345-192.168.203.48@tcp:101:bash.0 Request processed in 338us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.655396:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1789601569.658117:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.658311:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374528 00000100:00100000:3.0:1789601569.658321:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374528 00000100:00100000:3.0:1789601569.658380:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789601569.658405:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+6:12227:x1876532898374528:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601569.658423:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601569.658441:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ccc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.658469:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.658478:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601569.658482:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601569.658487:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.658520:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.658533:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601569.658547:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918374912:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601569.658949:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601569.661258:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918374912:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601569.661293:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.661314:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528e00, rc 0) 00000100:00100000:2.0:1789601569.661372:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:12227:x1876532898374528:12345-192.168.203.48@tcp:101:bash.0 Request processed in 2968us (3262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601569.661380:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:2.0:1789601569.663917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.664007:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374656 00000100:00100000:3.0:1789601569.664016:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374656 00010000:00010000:3.0:1789601569.664055:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601569.664097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:3.0:1789601569.664120:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898374656:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601569.664136:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601569.664157:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.664170:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.664193:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd0cf34f/0x74872e3eca9f1fc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cc5 expref: 7 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.664335:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601569.664349:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601569.664358:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.664368:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.664405:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601569.664417:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876532918375040:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789601569.664492:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d80a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601569.672373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.672501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898374912 00000100:00100000:1.0:1789601569.672511:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898374912 00000100:00100000:1.0:1789601569.672577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1789601569.672587:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:12227:x1876532898374912:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:1.0:1789601569.672861:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:12227:x1876532898374912:12345-192.168.203.48@tcp:35:bash.0 Request processed in 275us (496us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789601569.672868:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789601569.673162:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876532918375040:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789601569.673387:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601569.673423:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+6:2416:x1876532898374656:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 9304us (9512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.673431:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:2.0:1789601569.751302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.751419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898375168 00000100:00100000:1.0:1789601569.751428:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898375168 00000100:00100000:1.0:1789601569.751500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:1.0:1789601569.751509:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+20:12237:x1876532898375168:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601569.751537:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601569.751595:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cd3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601569.751698:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789601569.751809:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1fcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cd3 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.751823:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:1.0:1789601569.751827:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601569.751832:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cd3 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.751865:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1c00, rc 0) 00000100:00100000:1.0:1789601569.751925:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:12237:x1876532898375168:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 417us (632us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789601569.751932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:2.0:1789601569.756538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.756671:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898375424 00000100:00100000:1.0:1789601569.756680:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898375424 00000100:00100000:1.0:1789601569.756736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1789601569.756747:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:12237:x1876532898375424:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601569.756948:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+22:12237:x1876532898375424:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 202us (419us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789601569.756954:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:2.0:1789601569.848082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.848745:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898375552 00000100:00100000:0.0:1789601569.848757:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898375552 00000100:00100000:0.0:1789601569.848828:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00100000:0.0:1789601569.848840:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:12243:x1876532898375552:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601569.848864:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601569.848911:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cda expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.848980:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.848994:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.849006:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601569.849048:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789601569.849052:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601569.849071:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.849099:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f1fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cda expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.849121:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cda expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.849130:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601569.849133:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601569.849137:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601569.849235:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+23:12243:x1876532898375552:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 385us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.849242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00100000:0.0:1789601569.853464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.853593:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898375808 00000100:00100000:1.0:1789601569.853603:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898375808 00000100:00100000:1.0:1789601569.853658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:1.0:1789601569.853666:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+23:12243:x1876532898375808:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601569.853684:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601569.853701:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1feb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ce1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.853903:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1ff2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.853914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.853923:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601569.853937:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789601569.854024:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f1feb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.854040:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce1 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.854048:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:1.0:1789601569.854051:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601569.854055:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1000, rc 0) 00000100:00100000:1.0:1789601569.854165:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+25:12243:x1876532898375808:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 499us (710us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789601569.854173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:2.0:1789601569.857638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.857828:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376064 00000100:00100000:0.0:1789601569.857835:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376064 00000100:00100000:0.0:1789601569.857885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:0.0:1789601569.857894:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+25:12243:x1876532898376064:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601569.857917:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601569.857940:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2000 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ce8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.858044:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.858060:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.858069:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601569.858078:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789601569.858158:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2000 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce8 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.858176:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce8 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.858184:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:0.0:1789601569.858186:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789601569.858189:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467400, rc 0) 00000100:00100000:0.0:1789601569.858413:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+27:12243:x1876532898376064:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 518us (781us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789601569.858436:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:2.0:1789601569.859158:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.859234:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376192 00000100:00100000:3.0:1789601569.859240:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376192 00000100:00100000:3.0:1789601569.859531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601569.859543:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+27:2415:x1876532898376192:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601569.859628:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601569.859649:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f1ff2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce1 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.859667:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:3.0:1789601569.859671:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601569.859716:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+26:2415:x1876532898376192:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 176us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.859722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1789601569.870056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.870155:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376320 00000100:00100000:0.0:1789601569.870165:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376320 00000100:00100000:0.0:1789601569.870234:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789601569.870252:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+6:2418:x1876532898376320:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:0.0:1789601569.870297:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.870318:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.870326:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601569.870331:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601569.870336:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.870370:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.870393:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 6 pid: 8441 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601569.870407:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1876532918375168:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601569.870502:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f739b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601569.878215:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1876532918375168:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601569.878454:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601569.878611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.878929:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376448 00000100:00100000:0.0:1789601569.878937:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376448 00002000:00100000:0.0:1789601569.878987:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8df3c3427b80 x1876532898376448/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:165/0 lens 504/0 e 0 to 0 dl 1789601580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601569.878997:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3427b80 with x1876532898376448 ext(0->12) 00010000:00010000:0.0:1789601569.879004:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 7 pid: 8441 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.879017:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 7 pid: 8441 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601569.879025:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c3427b80 00000100:00100000:0.0:1789601569.879160:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789601569.879171:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898376448:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:0.0:1789601569.880147:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898376448:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 973us (1532us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789601569.880157:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:0.0:1789601569.880165:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8df3c3427b80 x1876532898376448/t4294967306(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:165/0 lens 504/448 e 0 to 0 dl 1789601580 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601569.880174:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3427b80 with x1876532898376448 ext(0->12) 00010000:00010000:0.0:1789601569.880181:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.880210:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601569.880217:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c3427b80 00000100:00100000:2.0:1789601569.882271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.882365:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376576 00000100:00100000:0.0:1789601569.882374:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376576 00010000:00010000:0.0:1789601569.882410:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601569.882452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:0.0:1789601569.882462:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2417:x1876532898376576:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601569.882589:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789601569.882605:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789601569.882607:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789601569 00002000:00010000:0.0:1789601569.882609:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789601569 00002000:00010000:0.0:1789601569.882610:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789601569 00002000:00010000:0.0:1789601569.882612:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789601569.882617:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.882626:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.882645:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af1d5ee/0x74872e3eca9f1fc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ccc expref: 9 pid: 8441 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.882673:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1789601569.882676:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601569.882680:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.882687:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.882712:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601569.882739:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882759:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601569.882774:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898376576:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 314us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1789601569.882779:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601569.882781:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00010000:00010000:2.0:1789601569.882787:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882795:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882802:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601569.882806:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882815:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882827:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601569.882834:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2015 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601569.882894:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2418:x1876532898376320:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 12651us (12848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601569.882902:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:2.0:1789601569.885429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601569.885818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376832 00000100:00100000:1.0:1789601569.885828:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376832 00000100:00100000:1.0:1789601569.885912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789601569.885922:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0980450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+26:12243:x1876532898376832:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:1.0:1789601569.885981:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce8 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601569.886177:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789601569.886213:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789601569.886755:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789601569.886795:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.886810:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 30 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.886834:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.886871:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 30 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.886891:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 30 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601569.886906:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876532918375296:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601569.887044:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43340c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601569.892188:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876532918375296:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601569.892217:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601569.893353:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601569.893501:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898376960 00000100:00100000:0.0:1789601569.893510:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898376960 00010000:00010000:0.0:1789601569.893546:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 31 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601569.893613:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:0.0:1789601569.893623:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+31:2416:x1876532898376960:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601569.893638:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601569.893645:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 31 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893659:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 31 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893702:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f1fb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cbe expref: 31 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893718:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:0.0:1789601569.893723:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893732:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893739:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601569.893769:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601569.893824:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+30:2416:x1876532898376960:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 202us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.893832:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00010000:00010000:1.0:1789601569.893850:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601569.893858:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601569.893969:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789601569.894091:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789601569.894179:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918375424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789601569.894239:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601569.894279:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601569.894327:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918375424 00000100:00100000:0.0:1789601569.894332:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918375424 00000100:00100000:0.0:1789601569.894381:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789601569.894389:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876532918375424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789601569.894477:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876532918375424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601569.894484:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789601569.894686:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918375424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601569.894807:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789601569.894856:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918375552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601569.894885:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601569.894909:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4334180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601569.894922:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918375552 00000100:00100000:0.0:1789601569.894935:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918375552 00000100:00100000:0.0:1789601569.894965:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789601569.894973:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1876532918375552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789601569.895082:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1876532918375552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (196us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789601569.895088:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789601569.895519:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876532918375552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601569.895576:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789601569.895606:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895621:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895628:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895681:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601569.895686:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895695:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895707:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:3.0:1789601569.895710:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601569.895714:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.895719:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f201c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601569.895871:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789601569.895928:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789601569.895939:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438017382373ns, next at 439017380396ns, rc = 0 00000001:00080000:3.0:1789601569.895945:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789601569.895965:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c99bb600) 00010000:00010000:3.0:1789601569.895968:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601569.895974:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f2007 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ce8 expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601569.896095:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0980450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:12243:x1876532898376832:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 10175us (10675us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789601569.896103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000020:00080000:3.0:1789601569.896107:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789601569.903822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.903939:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898377088 00000100:00100000:3.0:1789601569.903949:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898377088 00000100:00100000:3.0:1789601569.904014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:3.0:1789601569.904023:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+33:12243:x1876532898377088:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601569.904047:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601569.904081:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f2023 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cef expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.904140:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f2023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cef expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.904155:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f2023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cef expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601569.904172:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601569.904176:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601569.904179:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1528200, rc 0) 00000100:00100000:3.0:1789601569.904251:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+34:12243:x1876532898377088:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 229us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601569.904259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:2.0:1789601569.908217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601569.908366:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898377344 00000100:00100000:3.0:1789601569.908376:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898377344 00000100:00100000:3.0:1789601569.908452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789601569.908462:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+34:12243:x1876532898377344:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789601569.909066:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:12243:x1876532898377344:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 603us (858us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789601569.909075:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:2.0:1789601570.024756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.024896:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898377600 00000100:00100000:3.0:1789601570.024906:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898377600 00000100:00100000:3.0:1789601570.024970:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:3.0:1789601570.024980:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+35:12253:x1876532898377600:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601570.025003:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.025023:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f202a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cf6 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601570.025117:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789601570.025217:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f202a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cf6 expref: 37 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.025241:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:3.0:1789601570.025245:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601570.025250:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f202a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cf6 expref: 37 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.025266:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601570.025323:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+36:12253:x1876532898377600:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 345us (589us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789601570.025330:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:2.0:1789601570.028397:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.028873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898377728 00000100:00100000:3.0:1789601570.028883:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898377728 00000100:00100000:3.0:1789601570.028943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:3.0:1789601570.028954:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+36:12253:x1876532898377728:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1789601570.029040:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029059:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029072:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029083:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029091:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029098:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029636:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029649:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029658:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601570.029708:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029722:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029742:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029749:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029755:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.029760:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029768:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029781:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601570.029784:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601570.029789:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029796:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f2038 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029812:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029819:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029825:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029831:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.029839:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029846:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029854:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:3.0:1789601570.029857:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601570.029860:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029866:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f203f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029876:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029882:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029888:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029893:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.029896:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029903:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029910:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.029913:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601570.029921:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.029928:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f2046 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.030008:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+36:12253:x1876532898377728:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1054us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.030016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:2.0:1789601570.038720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601570.038823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898377984 00000100:00100000:1.0:1789601570.038847:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898377984 00000100:00100000:1.0:1789601570.038902:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789601570.038913:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+36:12253:x1876532898377984:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601570.039137:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+37:12253:x1876532898377984:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 225us (425us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789601570.039145:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1789601570.090631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.090713:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898378240 00000100:00100000:3.0:1789601570.090724:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898378240 00000100:00100000:3.0:1789601570.090893:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:3.0:1789601570.090904:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+37:12256:x1876532898378240:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601570.090926:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.090947:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f204d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48cfd expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091020:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091036:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091048:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091062:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091069:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091094:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091431:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091441:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091448:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601570.091458:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789601570.091531:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091538:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091545:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091551:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.091588:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091596:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091608:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601570.091611:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601570.091625:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091631:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363a00/0x74872e3eca9f2054 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091646:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091653:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091658:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091663:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.091665:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091671:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091679:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:3.0:1789601570.091682:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601570.091685:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091691:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528e00/0x74872e3eca9f205b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091733:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7362800/0x74872e3eca9f204d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 40 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091772:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 39 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.091779:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.091782:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601570.091784:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1529c00, rc 0) 00000100:00100000:3.0:1789601570.091849:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+39:12256:x1876532898378240:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 947us (1227us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789601570.091857:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:0.0:1789601570.101242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.101324:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898378368 00000100:00100000:3.0:1789601570.101334:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898378368 00000100:00100000:3.0:1789601570.101405:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:3.0:1789601570.101416:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+39:12256:x1876532898378368:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789601570.101484:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101501:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101514:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101548:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101589:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101616:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101622:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601570.101626:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101633:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101644:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.101648:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601570.101652:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.101658:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f2070 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.101724:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+39:12256:x1876532898378368:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 310us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.101732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:2.0:1789601570.105111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601570.105217:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898378624 00000100:00100000:1.0:1789601570.105244:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898378624 00000100:00100000:1.0:1789601570.105301:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1789601570.105311:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+39:12256:x1876532898378624:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601570.105719:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+40:12256:x1876532898378624:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 408us (615us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789601570.105726:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789601570.117861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918375680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601570.117973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601570.118161:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918375680 00000100:00100000:2.0:1789601570.118172:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918375680 00000100:00100000:2.0:1789601570.118265:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789601570.118277:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918375680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601570.118315:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789601570.118379:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918375680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.118386:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789601570.118467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918375808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601570.118546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601570.118667:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918375808 00000100:00100000:2.0:1789601570.118676:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918375808 00000100:00100000:2.0:1789601570.118749:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601570.118758:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918375808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601570.118781:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789601570.118826:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918375808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.118833:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601570.124869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c376e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918375680:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789601570.124929:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601570.130091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918375808:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789601570.443717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601570.465019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601570.465266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898378880 00000100:00100000:0.0:1789601570.465276:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898378880 00000100:00100000:0.0:1789601570.465344:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601570.465354:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+40:12287:x1876532898378880:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:0.0:1789601570.465377:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601570.465409:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f2077 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d04 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.465515:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f207e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.465529:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f207e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.465539:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f207e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601570.465550:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789601570.465688:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f2077 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d04 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.465707:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f207e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d04 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.465728:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601570.465731:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601570.465734:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467000, rc 0) 00000100:00100000:0.0:1789601570.465794:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+42:12287:x1876532898378880:12345-192.168.203.48@tcp:101:cat.0 Request processed in 441us (785us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789601570.465801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601570.476207:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.476491:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898379008 00000100:00100000:3.0:1789601570.476501:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898379008 00000100:00100000:3.0:1789601570.476599:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789601570.476610:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+42:2415:x1876532898379008:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601570.476626:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601570.476665:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f207e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d04 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.476685:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.476690:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601570.476756:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+41:2415:x1876532898379008:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 147us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.476764:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789601570.478213:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601570.478304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898379264 00000100:00100000:0.0:1789601570.478312:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898379264 00000100:00100000:0.0:1789601570.478359:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1789601570.478368:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+41:12287:x1876532898379264:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:0.0:1789601570.478616:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+42:12287:x1876532898379264:12345-192.168.203.48@tcp:35:cat.0 Request processed in 249us (409us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789601570.478623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789601570.587316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.587639:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898379520 00000100:00100000:3.0:1789601570.587649:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898379520 00000100:00100000:3.0:1789601570.587711:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:3.0:1789601570.587720:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+42:12293:x1876532898379520:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789601570.587752:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.587755:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789601570.587780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f1fe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cda expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.587800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601570.587804:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601570.587816:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f208c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d0b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.587914:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.587928:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 42 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.587958:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.587988:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 42 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.588000:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 42 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.588011:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918375936:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601570.588109:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e14e6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.590466:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918375936:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601570.590494:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601570.591911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.599737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898379648 00000100:00100000:3.0:1789601570.599753:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898379648 00010000:00010000:3.0:1789601570.599797:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 43 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.599906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1789601570.599916:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+43:2415:x1876532898379648:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601570.599934:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601570.599941:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 43 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.599974:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 43 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.599995:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529c00/0x74872e3eca9f2062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cfd expref: 43 pid: 9040 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.600011:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.600016:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.600025:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.600033:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.600084:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601570.600152:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+42:2415:x1876532898379648:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 237us (8246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.600168:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00010000:00010000:1.0:1789601570.600250:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.600258:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601570.600277:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789601570.600409:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f208c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.600426:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.600446:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601570.600449:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601570.600451:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679600, rc 0) 00000100:00100000:1.0:1789601570.600493:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+42:12293:x1876532898379520:12345-192.168.203.48@tcp:101:dd.0 Request processed in 12774us (13185us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789601570.600500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:2.0:1789601570.605925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601570.606755:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898379776 00000100:00100000:0.0:1789601570.606766:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898379776 00000100:00100000:0.0:1789601570.606822:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:0.0:1789601570.606833:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+42:12293:x1876532898379776:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:0.0:1789601570.606857:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601570.606875:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f20a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d12 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.606908:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.606937:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.606949:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607723:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f20a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607757:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607765:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601570.607768:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601570.607771:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467c00, rc 0) 00000100:00100000:0.0:1789601570.607833:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+43:12293:x1876532898379776:12345-192.168.203.48@tcp:101:dd.0 Request processed in 1001us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.607841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:2.0:1789601570.611492:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601570.611599:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380032 00000100:00100000:0.0:1789601570.611617:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380032 00000100:00100000:0.0:1789601570.611666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:0.0:1789601570.611677:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+43:12293:x1876532898380032:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:0.0:1789601570.612236:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.612255:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.612287:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601570.612337:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1789601570.612361:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed412e19 reply state 000000003fe7b56b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.612374:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.612382:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601570.612385:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601570.612389:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601570.612477:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+46:12293:x1876532898380032:12345-192.168.203.48@tcp:36:dd.0 Request processed in 801us (992us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789601570.612485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 169 00000020:00080000:0.0:1789601570.612490:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789601570.920988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.921104:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380160 00000100:00100000:3.0:1789601570.921114:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380160 00000100:00100000:3.0:1789601570.921232:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:3.0:1789601570.921244:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+46:12307:x1876532898380160:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:3.0:1789601570.921269:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.921291:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f20b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d19 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921393:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921407:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921421:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921432:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921439:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921445:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921510:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921521:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921529:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921603:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.921640:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 47 pid: 6521 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.921653:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918376064:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601570.922109:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e14e6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.931376:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918376064:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601570.931520:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601570.940465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601570.942514:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380416 00000100:00100000:1.0:1789601570.942531:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380416 00000100:00100000:1.0:1789601570.942675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1789601570.942688:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+48:6187:x1876532898380416:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789601570.943129:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+49:6187:x1876532898380416:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 443us (2672us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789601570.943137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1789601570.959683:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601570.960313:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380544 00000100:00100000:3.0:1789601570.960324:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380544 00010000:00010000:3.0:1789601570.960379:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 49 pid: 6521 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601570.960424:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:3.0:1789601570.960434:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3639c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+49:2415:x1876532898380544:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601570.960448:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601570.960454:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 49 pid: 6521 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960467:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 49 pid: 6521 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960488:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2093 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d0b expref: 49 pid: 6521 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960526:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601570.960531:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960540:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960607:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.960644:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601570.960697:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3639c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+48:2415:x1876532898380544:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 264us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.960704:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00010000:00010000:2.0:1789601570.961365:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961375:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601570.961435:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789601570.961439:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601570.961458:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961486:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961495:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961501:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961506:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961511:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601570.961515:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961522:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961531:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601570.961534:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601570.961537:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961543:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f20bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961588:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961594:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961606:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961611:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601570.961613:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961619:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961626:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:2.0:1789601570.961628:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601570.961631:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961636:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f20c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961669:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f20b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d19 expref: 48 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961683:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d19 expref: 47 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.961690:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601570.961692:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601570.961694:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679200, rc 0) 00000100:00100000:2.0:1789601570.962041:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+47:12307:x1876532898380160:12345-192.168.203.48@tcp:101:stat.0 Request processed in 40798us (41060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.962059:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:2.0:1789601571.055354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.056153:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380800 00000100:00100000:1.0:1789601571.056169:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380800 00000100:00100000:1.0:1789601571.056320:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:1.0:1789601571.056335:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+47:12313:x1876532898380800:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:1.0:1789601571.056417:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601571.056455:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f20cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d19 expref: 47 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.056494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601571.056500:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601571.057152:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.057191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.057204:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601571.057272:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789601571.057298:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f40a91f9 reply state 00000000a595e3bf transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.057312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.057320:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601571.057323:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601571.057327:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601571.057457:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+49:12313:x1876532898380800:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 1124us (2115us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789601571.057466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000020:00080000:1.0:1789601571.057484:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789601571.058331:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601571.148399:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601571.148434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918376192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601571.148541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601571.149302:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918376192 00000100:00100000:1.0:1789601571.149315:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918376192 00000100:00100000:1.0:1789601571.149390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789601571.149402:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918376192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601571.149449:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601571.149546:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918376192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601571.149553:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789601571.149783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c2a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918376192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601571.240036:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.240335:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898380928 00000100:00100000:0.0:1789601571.240349:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898380928 00000100:00100000:0.0:1789601571.240429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:0.0:1789601571.240442:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+49:12327:x1876532898380928:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:0.0:1789601571.240477:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601571.240506:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f20d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d20 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240664:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240683:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240698:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240711:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240719:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240726:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.240995:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241007:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241016:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601571.241201:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789601571.241208:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601571.241251:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241279:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241290:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241297:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241304:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241310:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601571.241316:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241324:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241339:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601571.241343:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601571.241349:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241356:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f20e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241372:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241379:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241394:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241399:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601571.241402:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241409:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241418:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:0.0:1789601571.241421:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601571.241425:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241431:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f20e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241480:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f20d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241499:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.241513:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601571.241515:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601571.241518:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467e00, rc 0) 00000100:00100000:0.0:1789601571.241922:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+50:12327:x1876532898380928:12345-192.168.203.48@tcp:101:stat.0 Request processed in 1481us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.242005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:2.0:1789601571.326479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.327174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898381184 00000100:00100000:3.0:1789601571.327188:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898381184 00000100:00100000:3.0:1789601571.327356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:3.0:1789601571.327369:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+50:12337:x1876532898381184:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601571.327397:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601571.327424:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f20f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601571.327645:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789601571.327921:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f20f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d27 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.327960:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:3.0:1789601571.327964:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601571.327971:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f20f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d27 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.327990:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679600, rc 0) 00000100:00100000:3.0:1789601571.328084:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+51:12337:x1876532898381184:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 718us (1620us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789601571.328093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:3.0:1789601571.332902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.333039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898381440 00000100:00100000:1.0:1789601571.333078:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898381440 00000100:00100000:1.0:1789601571.333146:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789601571.333158:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0983850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+51:12337:x1876532898381440:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601571.334758:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0983850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+52:12337:x1876532898381440:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 1589us (1857us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789601571.334773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:2.0:1789601571.397074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.397176:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898381696 00000100:00100000:3.0:1789601571.397190:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898381696 00000100:00100000:3.0:1789601571.397280:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:3.0:1789601571.397293:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+52:12343:x1876532898381696:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601571.397328:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601571.397356:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2103 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d2e expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.397509:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.397528:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.397539:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.397670:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.397687:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 53 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601571.397703:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918376320:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601571.397834:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e14e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601571.401908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.402011:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898381824 00000100:00100000:0.0:1789601571.402024:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898381824 00010000:00010000:0.0:1789601571.402093:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 54 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601571.402143:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:0.0:1789601571.402154:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+54:2415:x1876532898381824:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601571.402171:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601571.402179:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 54 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.402194:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 54 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.402234:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601571.402241:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.402253:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.402262:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.402287:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601571.402368:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+54:2415:x1876532898381824:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 215us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.402396:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00010000:00010000:3.0:1789601571.402995:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f20ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d20 expref: 53 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601571.403015:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918376320:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601571.403043:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.403054:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.403060:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601571.403084:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789601571.403300:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2103 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 54 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.403319:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 53 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.403343:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601571.403346:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601571.403349:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679a00, rc 0) 00000100:00100000:3.0:1789601571.403405:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+53:12343:x1876532898381696:12345-192.168.203.48@tcp:101:bash.0 Request processed in 6116us (6359us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789601571.403414:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:2.0:1789601571.407057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.407164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382080 00000100:00100000:1.0:1789601571.407177:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382080 00000100:00100000:1.0:1789601571.407260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:1.0:1789601571.407272:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+53:12343:x1876532898382080:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:1.0:1789601571.407630:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.407653:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.407667:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601571.407719:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789601571.407754:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075a2a495 reply state 0000000006893c67 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.407769:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.407777:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601571.407780:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601571.407785:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601571.407900:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+56:12343:x1876532898382080:12345-192.168.203.48@tcp:36:bash.0 Request processed in 629us (869us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789601571.407924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 175 00000020:00080000:1.0:1789601571.407931:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789601571.414793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.415997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382208 00000100:00100000:0.0:1789601571.416014:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382208 00000100:00100000:0.0:1789601571.416101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:0.0:1789601571.416112:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+56:12343:x1876532898382208:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601571.416135:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601571.416167:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f211f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d35 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.416270:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.416286:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 57 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.416294:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.416333:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 57 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.416359:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 57 pid: 9040 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601571.416373:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918376448:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601571.416468:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f739bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601571.423121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.423237:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382336 00000100:00100000:3.0:1789601571.423255:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382336 00010000:00010000:3.0:1789601571.423322:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 58 pid: 9040 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601571.423460:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918376448:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601571.423503:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601571.423974:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:3.0:1789601571.423989:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+58:2416:x1876532898382336:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601571.424010:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601571.424019:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 58 pid: 9040 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424035:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 58 pid: 9040 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424059:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f210a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d2e expref: 58 pid: 9040 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424077:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601571.424081:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424103:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424109:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.424131:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601571.424202:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+57:2416:x1876532898382336:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 216us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601571.424210:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00010000:00010000:0.0:1789601571.424391:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.424403:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601571.424463:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789601571.424468:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601571.424490:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.424528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f211f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d35 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.424548:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d35 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.424601:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601571.424605:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601571.424608:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466c00, rc 0) 00000100:00100000:0.0:1789601571.424662:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+57:12343:x1876532898382208:12345-192.168.203.48@tcp:101:bash.0 Request processed in 8552us (9936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.424671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:2.0:1789601571.430029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.430602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382592 00000100:00100000:1.0:1789601571.430617:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382592 00000100:00100000:1.0:1789601571.430694:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:1.0:1789601571.430707:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+56:12343:x1876532898382592:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:1.0:1789601571.431027:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+57:12343:x1876532898382592:12345-192.168.203.48@tcp:35:bash.0 Request processed in 322us (1015us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789601571.431035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00010000:00010000:1.0:1789601571.462612:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601571.540929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.541150:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382848 00000100:00100000:1.0:1789601571.541159:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382848 00000100:00100000:1.0:1789601571.541352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 177 00000100:00100000:1.0:1789601571.541363:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+57:12353:x1876532898382848:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601571.541388:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601571.541413:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f212d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d3c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601571.541535:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789601571.541700:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f212d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d3c expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.541714:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:1.0:1789601571.541717:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601571.541723:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1000/0x74872e3eca9f212d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d3c expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.541782:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1000, rc 0) 00000100:00100000:1.0:1789601571.541847:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+58:12353:x1876532898382848:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 486us (928us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1789601571.541864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 177 00000100:00100000:2.0:1789601571.555889:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.556657:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898382976 00000100:00100000:3.0:1789601571.556669:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898382976 00000100:00100000:3.0:1789601571.556726:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 178 00000100:00100000:3.0:1789601571.556737:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+58:12353:x1876532898382976:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1789601571.556826:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.556843:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.556855:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.556866:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.556872:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.556878:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557804:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557820:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557829:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601571.557886:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557899:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557910:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557918:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.557924:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601571.557927:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558624:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558644:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601571.558647:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601571.558654:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558710:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f213b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558730:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558795:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558802:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558808:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601571.558812:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558818:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558826:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:3.0:1789601571.558828:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601571.558831:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558837:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558847:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558853:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558866:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558871:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601571.558875:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558880:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558888:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601571.558890:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601571.558893:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.558899:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601571.559002:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+58:12353:x1876532898382976:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 2263us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601571.559011:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 178 00000100:00100000:2.0:1789601571.563394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.563541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898383232 00000100:00100000:3.0:1789601571.563552:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898383232 00000100:00100000:2.0:1789601571.563937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:2.0:1789601571.563952:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+58:12353:x1876532898383232:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789601571.564286:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+59:12353:x1876532898383232:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 229us (794us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789601571.564294:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:2.0:1789601571.649396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.649677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898383488 00000100:00100000:3.0:1789601571.649690:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898383488 00000100:00100000:3.0:1789601571.649768:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:3.0:1789601571.649781:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+59:12356:x1876532898383488:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601571.649808:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601571.649832:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d43 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649933:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649951:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649975:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649983:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.649989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650097:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f2165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650106:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f2165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f2165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601571.650124:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601571.650476:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650484:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650500:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650506:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601571.650510:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650519:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650531:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601571.650534:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601571.650539:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650635:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650654:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650661:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650668:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650673:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601571.650676:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650693:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650701:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:3.0:1789601571.650703:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601571.650706:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650712:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f215e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650903:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d43 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650921:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f2165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d43 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.650929:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601571.650932:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601571.650934:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679200, rc 0) 00000100:00100000:3.0:1789601571.651084:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+61:12356:x1876532898383488:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1304us (1698us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789601571.651092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:1.0:1789601571.662613:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918376576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601571.662676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601571.662801:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918376576 00000100:00100000:0.0:1789601571.662809:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918376576 00000100:00100000:0.0:1789601571.662851:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789601571.662860:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918376576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601571.662912:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789601571.662968:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918376576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.662974:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789601571.663063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918376576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601571.667107:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.667157:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.667261:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898383616 00000100:00100000:2.0:1789601571.667271:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898383744 00000100:00100000:0.0:1789601571.667275:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898383616 00000100:00100000:2.0:1789601571.667288:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898383744 00000100:00100000:0.0:1789601571.667382:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789601571.667390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:0.0:1789601571.667398:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+62:2415:x1876532898383616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789601571.667410:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+62:12356:x1876532898383744:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789601571.667422:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601571.667459:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679200/0x74872e3eca9f2165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d43 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.667484:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.667495:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601571.667504:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601571.667706:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+61:2415:x1876532898383616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 313us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.667714:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00010000:00010000:2.0:1789601571.672577:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672627:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672674:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672681:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672688:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672694:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601571.672698:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672704:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672716:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601571.672719:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601571.672723:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.672729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2173 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601571.672957:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+60:12356:x1876532898383744:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 5550us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601571.672967:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:1.0:1789601571.681766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.681853:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898384000 00000100:00100000:0.0:1789601571.681863:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898384000 00000100:00100000:0.0:1789601571.681921:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1789601571.681932:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+60:12356:x1876532898384000:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601571.682178:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+61:12356:x1876532898384000:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 248us (421us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789601571.682185:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1789601571.896077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601571.896176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898384256 00000100:00100000:3.0:1789601571.896186:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898384256 00000100:00100000:3.0:1789601571.896259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:3.0:1789601571.896270:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+61:12374:x1876532898384256:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1789601571.896318:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601571.896338:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f217a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d4a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.896448:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f2181 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.896463:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f2181 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.896477:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f2181 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601571.896488:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601571.896617:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f217a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d4a expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.896637:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f2181 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d4a expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.896646:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:3.0:1789601571.896649:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789601571.896652:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679a00, rc 0) 00000100:00100000:3.0:1789601571.896847:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+63:12374:x1876532898384256:12345-192.168.203.48@tcp:101:cat.0 Request processed in 578us (778us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789601571.896855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:3.0:1789601571.931262:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601571.931513:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898384384 00000100:00100000:2.0:1789601571.931539:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898384384 00000100:00100000:2.0:1789601571.931652:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:2.0:1789601571.931664:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:12375:x1876532898384384:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601571.931691:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601571.931712:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f218f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d51 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.931786:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.931800:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.931812:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601571.932040:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789601571.932044:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601571.932062:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.932087:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f218f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d51 expref: 65 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.932105:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d51 expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.932114:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601571.932117:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601571.932121:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382200, rc 0) 00000100:00100000:2.0:1789601571.932202:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+64:12375:x1876532898384384:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 540us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601571.932218:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1789601571.937605:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.940190:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898384768 00000100:00100000:1.0:1789601571.940207:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898384768 00000100:00100000:1.0:1789601571.940292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1789601571.940304:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+64:12375:x1876532898384768:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789601571.940849:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+65:12375:x1876532898384768:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 544us (3295us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789601571.940859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1789601571.945745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601571.945922:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898384896 00000100:00100000:1.0:1789601571.945936:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898384896 00000100:00100000:1.0:1789601571.946328:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1789601571.946355:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12375:x1876532898384896:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:1.0:1789601571.946377:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789601571.946414:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2126 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d35 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.946460:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679a00/0x74872e3eca9f2181 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d4a expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.946477:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528200/0x74872e3eca9f2023 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cef expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601571.946489:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601571.946496:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601571.947242:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+62:12375:x1876532898384896:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 888us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601571.947252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789601571.950486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.950697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385024 00000100:00100000:0.0:1789601571.950710:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385024 00000100:00100000:0.0:1789601571.950780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 183 00000100:00100000:0.0:1789601571.950792:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+62:12375:x1876532898385024:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:0.0:1789601571.950944:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.950966:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.950979:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601571.951117:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789601571.951242:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+62:12375:x1876532898385024:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 453us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.951251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 183 00000100:00100000:3.0:1789601571.975008:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601571.982601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385152 00000100:00100000:0.0:1789601571.982624:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385152 00000100:00100000:0.0:1789601571.982719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:0.0:1789601571.982795:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+62:12377:x1876532898385152:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601571.982823:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601571.982850:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d58 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.982932:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.983637:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.983675:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.983692:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.983701:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.983708:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984198:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984221:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984230:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601571.984294:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789601571.984299:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601571.984325:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984340:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984351:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984370:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984378:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984385:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601571.984391:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984400:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984415:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601571.984419:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601571.984425:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984433:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f21ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.984448:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985354:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985362:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985367:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601571.985380:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985388:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985401:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:0.0:1789601571.985404:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601571.985408:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985415:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985766:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601571.985775:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601571.985777:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601571.985781:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467000, rc 0) 00000100:00100000:0.0:1789601571.985887:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+63:12377:x1876532898385152:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3094us (10954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601571.985898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 184 00010000:00010000:1.0:1789601572.494147:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601572.552237:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601572.552247:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601572.552343:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789601572.552349:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601572.552669:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918376704:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601572.552778:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.579068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.579104:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385280 00000100:00100000:3.0:1789601572.579112:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385280 00000100:00100000:3.0:1789601572.579160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:3.0:1789601572.579170:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898385280:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601572.579201:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601572.579332:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898385280:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 163us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.579339:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:1.0:1789601572.579985:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918376704:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601572.587127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.594313:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385408 00000100:00100000:2.0:1789601572.594330:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385408 00000100:00100000:2.0:1789601572.594407:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:2.0:1789601572.594418:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:12388:x1876532898385408:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789601572.594692:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594710:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594722:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594737:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594744:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594750:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594801:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594812:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594818:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601572.594863:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789601572.594867:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601572.594880:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594891:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594897:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594903:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594909:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.594913:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594921:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594932:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:2.0:1789601572.594940:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.594946:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594951:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f21c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594966:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594972:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594977:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594981:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.594983:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594989:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.594995:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8df3c341c900) 00010000:00010000:2.0:1789601572.594998:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.595001:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595006:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595020:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595032:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595038:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595043:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.595047:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595052:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595061:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.595064:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.595067:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.595073:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.595174:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+63:12388:x1876532898385408:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 756us (8054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.595182:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:3.0:1789601572.599761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601572.599898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385664 00000100:00100000:0.0:1789601572.599907:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385664 00000100:00100000:0.0:1789601572.599973:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:0.0:1789601572.599983:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+63:12388:x1876532898385664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601572.600023:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601572.600056:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d5f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600159:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600197:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601572.600218:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789601572.600295:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600303:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600310:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600316:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601572.600320:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600328:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600339:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:0.0:1789601572.600348:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601572.600354:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600361:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f21dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600403:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d5f expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600413:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:0.0:1789601572.600415:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601572.600418:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f21d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d5f expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.600427:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601572.600487:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898385664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 506us (737us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789601572.600493:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:3.0:1789601572.608710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.608947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898385792 00000100:00100000:2.0:1789601572.608959:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898385792 00000100:00100000:2.0:1789601572.609019:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:2.0:1789601572.609030:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898385792:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601572.609067:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601572.609342:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4e0f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898385792:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 313us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.609350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:0.0:1789601572.637017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.640650:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386048 00000100:00100000:2.0:1789601572.640665:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386048 00000100:00100000:2.0:1789601572.640756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:2.0:1789601572.640766:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898386048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601572.640787:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601572.640790:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789601572.640817:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2196 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d51 expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.640838:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601572.640843:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601572.640856:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d66 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601572.641243:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789601572.641377:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.641728:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.641740:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.641802:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f21ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d66 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.641835:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d66 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.641843:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df3c341c900) 00010000:00010000:2.0:1789601572.641846:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601572.641849:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382400, rc 0) 00000100:00100000:2.0:1789601572.641926:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+65:12388:x1876532898386048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1161us (4918us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789601572.641935:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789601572.655826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.656065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386304 00000100:00100000:3.0:1789601572.656075:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386304 00000100:00100000:3.0:1789601572.656135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:3.0:1789601572.656146:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12388:x1876532898386304:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601572.656198:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601572.656234:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f21f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d66 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656252:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df3c341c900) 00010000:00010000:3.0:1789601572.656263:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601572.656286:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656299:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656319:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656334:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656342:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656348:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656403:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656412:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656419:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656424:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601572.656428:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656435:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656443:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:3.0:1789601572.656446:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601572.656450:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656463:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f21ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656475:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656481:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656486:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656491:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601572.656495:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656500:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656508:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3dc6fe4c (ffff8df4c3bebb00) 00010000:00010000:3.0:1789601572.656511:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601572.656513:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.656518:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2206 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dc6fe4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.656741:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898386304:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 594us (922us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601572.656750:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:3.0:1789601572.663108:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.663194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386432 00000100:00100000:1.0:1789601572.663214:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386432 00000100:00100000:1.0:1789601572.663280:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:1.0:1789601572.663290:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+64:12388:x1876532898386432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601572.663309:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601572.663331:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f220d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663365:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663377:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663418:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663530:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f220d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663547:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.663589:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:1.0:1789601572.663592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601572.663596:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eec00, rc 0) 00000100:00100000:1.0:1789601572.663653:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+65:12388:x1876532898386432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 365us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601572.663660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:0.0:1789601572.671162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.671240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386688 00000100:00100000:2.0:1789601572.671250:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386688 00000100:00100000:2.0:1789601572.671313:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:2.0:1789601572.671323:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12388:x1876532898386688:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601572.671413:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.671431:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.671443:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601572.671628:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789601572.671638:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440793080504ns, next at 441793078327ns, rc = 0 00000004:00010000:2.0:1789601572.671802:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c33f0c4 reply state 00000000673b8541 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.671835:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.671843:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:2.0:1789601572.671846:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789601572.671849:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601572.671942:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+67:12388:x1876532898386688:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 620us (791us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789601572.671950:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:3.0:1789601572.676686:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.678434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386816 00000100:00100000:1.0:1789601572.678447:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386816 00000100:00100000:1.0:1789601572.678510:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:1.0:1789601572.678520:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:12388:x1876532898386816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601572.678542:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601572.678588:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d74 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.678645:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.678659:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.678877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:1.0:1789601572.678880:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601572.678884:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601572.678953:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+68:12388:x1876532898386816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 434us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601572.678961:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:2.0:1789601572.685435:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.685590:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898386944 00000100:00100000:3.0:1789601572.685611:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898386944 00000100:00100000:3.0:1789601572.688649:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1789601572.688726:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+6:2415:x1876532898386944:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789601572.688958:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898386944:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 293us (3528us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789601572.688965:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00080000:2.0:1789601572.689078:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601572.698102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.698174:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898387200 00000100:00100000:3.0:1789601572.698185:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898387200 00000100:00100000:3.0:1789601572.698258:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1789601572.698268:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+68:12388:x1876532898387200:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789601572.698496:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+69:12388:x1876532898387200:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 229us (402us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789601572.698504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1789601572.705242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.705376:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898387456 00000100:00100000:2.0:1789601572.705387:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898387456 00000100:00100000:2.0:1789601572.705448:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:2.0:1789601572.705459:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+69:12388:x1876532898387456:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601572.706871:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+69:12388:x1876532898387456:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 1406us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.706883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:0.0:1789601572.718262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.718596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898387584 00000100:00100000:2.0:1789601572.718607:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898387584 00000100:00100000:2.0:1789601572.718658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:2.0:1789601572.718679:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+69:12388:x1876532898387584:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601572.718700:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601572.718730:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2229 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718825:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718837:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601572.718882:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601572.718900:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718924:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2229 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d7b expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718943:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d7b expref: 70 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.718951:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:2.0:1789601572.718954:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601572.718958:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383c00, rc 0) 00000100:00100000:2.0:1789601572.719020:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+70:12388:x1876532898387584:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 354us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.719028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:1.0:1789601572.727964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.728050:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898387712 00000100:00100000:3.0:1789601572.728062:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898387712 00000100:00100000:3.0:1789601572.728121:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1789601572.728131:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898387712:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601572.728148:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601572.728166:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d82 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601572.728190:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab2724, blocks: 0x0 00010000:00010000:3.0:1789601572.728220:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789601572.728225:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601572.728233:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.728274:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.728286:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678200, rc 0) 00000100:00100000:3.0:1789601572.728350:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c376d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898387712:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 220us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.728357:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:0.0:1789601572.737501:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.737611:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898387968 00000100:00100000:2.0:1789601572.737621:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898387968 00000100:00100000:2.0:1789601572.737690:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:2.0:1789601572.737718:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+70:12388:x1876532898387968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601572.737842:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+70:12388:x1876532898387968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.737849:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:0.0:1789601572.741595:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.741664:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388096 00000100:00100000:1.0:1789601572.741674:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388096 00000100:00100000:1.0:1789601572.741736:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1789601572.741746:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:12388:x1876532898388096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601572.741763:0:8857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601572.741780:0:8857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d89 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.741810:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.741819:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601572.741823:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601572.741828:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 9 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.741876:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.741904:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.741919:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918376832:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601572.742007:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.749939:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918376832:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601572.749974:0:8857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 9 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.749995:0:8857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:3.0:1789601572.750072:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:12388:x1876532898388096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 8326us (8518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.750081:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:0.0:1789601572.755847:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.756668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388224 00000100:00100000:3.0:1789601572.756678:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388224 00010000:00010000:3.0:1789601572.756737:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601572.756779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:3.0:1789601572.756789:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898388224:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601572.756806:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601572.756850:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.756865:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.756886:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008423b5ec/0x74872e3eca9f2237 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d82 expref: 9 pid: 8440 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.756904:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601572.756908:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601572.756916:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.756925:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.756963:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601572.756978:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0100e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1876532918376960:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789601572.757069:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.762446:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0100e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1876532918376960:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789601572.762473:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601572.762528:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898388224:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 5740us (6689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.762581:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:0.0:1789601572.762760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.763185:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388352 00000100:00100000:3.0:1789601572.763194:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388352 00002000:00100000:3.0:1789601572.763258:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8df3c410c000 x1876532898388352/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:168/0 lens 504/0 e 0 to 0 dl 1789601583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601572.763268:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c410c000 with x1876532898388352 ext(0->8) 00002000:00010000:3.0:1789601572.763273:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c410c000 00000100:00100000:3.0:1789601572.763302:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789601572.763311:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898388352:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789601572.773437:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+10:2416:x1876532898388352:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 10118us (10668us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789601572.773451:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00002000:00100000:3.0:1789601572.773464:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8df3c410c000 x1876532898388352/t4294967315(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:168/0 lens 504/448 e 0 to 0 dl 1789601583 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601572.773473:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c410c000 with x1876532898388352 ext(0->8) 00002000:00010000:3.0:1789601572.773479:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c410c000 00000100:00100000:0.0:1789601572.780397:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.780482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388480 00000100:00100000:1.0:1789601572.780493:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388480 00000100:00100000:1.0:1789601572.780593:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:1.0:1789601572.780603:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+70:12388:x1876532898388480:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789601572.798457:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789601572.798473:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1789601572.798537:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789601572.798573:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4c4334540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789601572.798578:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7204600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4d80a4900 00000020:00080000:2.0:1789601572.798581:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7204800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c360a800 00010000:00010000:2.0:1789601572.798627:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798639:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798645:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798651:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1528800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.798656:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798664:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798681:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df4c3beb000) 00010000:00010000:2.0:1789601572.798684:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.798699:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798706:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528800/0x74872e3eca9f1f66 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798738:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798744:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798750:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798756:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.798758:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798764:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798772:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601572.798774:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.798777:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798783:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7363e00/0x74872e3eca9f1f6d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798800:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798806:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798819:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798824:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.798828:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798834:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798842:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c99bba00) 00010000:00010000:2.0:1789601572.798845:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.798848:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798854:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f1fac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798869:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798876:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798882:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798887:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.798890:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798907:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798915:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.798917:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.798920:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798925:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467400/0x74872e3eca9f20af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798935:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798941:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798946:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798951:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.798954:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798959:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798965:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.798967:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.798969:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798982:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f20d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.798995:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799000:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799004:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799008:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e0e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.799011:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799016:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799023:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.799025:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601572.799027:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799032:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f2118 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799042:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799047:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799057:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799062:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.799065:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799071:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799078:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:2.0:1789601572.799080:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601572.799083:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.799089:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f221b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.799188:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918377088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789601572.799272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601572.799329:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918377088 00000100:00100000:2.0:1789601572.799337:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918377088 00000100:00100000:2.0:1789601572.799387:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789601572.799396:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918377088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789601572.799526:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789601572.799530:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789601572 00002000:00010000:2.0:1789601572.799533:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789601572.799535:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789601572 -> 1789601572 00002000:00010000:2.0:1789601572.799537:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789601572.799606:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918377088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (334us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789601572.799614:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:2.0:1789601572.799654:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df3c359ca80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789601572.799659:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918377088:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789601572.799671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1789601572.800497:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789601572.800538:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789601572.805817:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918377216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789601572.805899:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601572.805966:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918377216 00000100:00100000:0.0:1789601572.805975:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918377216 00000100:00100000:0.0:1789601572.806046:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789601572.806055:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876532918377216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789601572.806083:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1789601572.806118:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab2721, atime: 0x6aab2721, ctime: 0x6aab2721, blocks: 0x8 00010000:00010000:0.0:1789601572.806126:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.806142:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1789601572.806147:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601572.806153:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.806170:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.806181:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.806229:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.806248:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789601572.806394:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876532918377216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 341us (495us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789601572.806402:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789601572.806423:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789601572.806452:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4c12aed80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789601572.806458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918377216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789601572.806946:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+19:12388:x1876532898388480:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 26341us (26556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601572.806956:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 197 00010000:00010000:1.0:1789601572.806979:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601572.806985:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.806994:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601572.806999:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.807009:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.807052:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.807061:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f2245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.807084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601572.807086:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601572.807088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601572.810520:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789601572.815921:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.818495:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388608 00000100:00100000:3.0:1789601572.818509:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388608 00000100:00100000:3.0:1789601572.818606:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789601572.818617:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+10:2415:x1876532898388608:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789601572.821615:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1789601572.821629:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1789601572.827542:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898388608:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 8917us (11618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.827575:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789601572.841881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601572.842138:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388864 00000100:00100000:0.0:1789601572.842149:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388864 00000100:00100000:0.0:1789601572.842339:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:0.0:1789601572.842353:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:12388:x1876532898388864:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789601572.842407:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601572.842435:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d7b expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.842453:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601572.842457:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601572.842498:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.842512:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.842530:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601572.842669:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6412b4b reply state 000000001b640bde transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.842682:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.842688:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601572.842691:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789601572.842693:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601572.845608:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+20:12388:x1876532898388864:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 3249us (3727us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789601572.848847:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:0.0:1789601572.855232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.855322:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898388992 00000100:00100000:1.0:1789601572.855332:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898388992 00000100:00100000:1.0:1789601572.855392:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789601572.855402:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898388992:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789601572.855845:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789601572.855849:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789601572 -> 1789601571 00002000:00010000:1.0:1789601572.855852:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789601569 00002000:00010000:1.0:1789601572.855854:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789601572 -> 1789601571 00002000:00010000:1.0:1789601572.855856:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789601572.855956:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898388992:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 555us (731us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789601572.855964:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789601572.879313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601572.881280:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898389248 00000100:00100000:2.0:1789601572.881298:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898389248 00000100:00100000:2.0:1789601572.881673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:2.0:1789601572.881684:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:12388:x1876532898389248:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789601572.882175:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.882194:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.882214:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.882249:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.882264:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.882294:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918377344:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601572.882392:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789601572.885785:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601572.885819:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898389376 00000100:00100000:0.0:1789601572.885828:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898389376 00010000:00010000:0.0:1789601572.885870:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 21 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.885905:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:0.0:1789601572.885914:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:2415:x1876532898389376:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601572.885928:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601572.885934:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 21 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.885965:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 21 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.885989:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601572.885994:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.886004:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.886012:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.886033:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601572.886095:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:2415:x1876532898389376:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 181us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601572.886102:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00010000:00010000:3.0:1789601572.887092:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d6d expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601572.887130:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918377344:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601572.887153:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887163:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887169:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887227:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887235:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887242:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887247:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601572.887252:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887260:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887273:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:3.0:1789601572.887276:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789601572.887280:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.887292:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2253 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601572.887376:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:12388:x1876532898389248:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 5694us (8073us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789601572.887385:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:0.0:1789601572.896240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.896414:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898389504 00000100:00100000:1.0:1789601572.896426:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898389504 00000100:00100000:1.0:1789601572.896488:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:1.0:1789601572.896499:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898389504:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789601572.896552:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.896688:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.896698:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789601572.896702:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601572.896708:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.896752:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.896768:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.896782:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1876532918377472:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601572.896905:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601572.913100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601572.913166:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898389632 00000100:00100000:0.0:1789601572.913175:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898389632 00010000:00010000:0.0:1789601572.913223:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 9 pid: 8857 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.913265:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:0.0:1789601572.913275:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898389632:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601572.913290:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601572.913312:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 9 pid: 8857 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913341:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 9 pid: 8857 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913368:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601572.913372:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601572.913378:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913387:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913406:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601572.913452:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898389632:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 177us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601572.913459:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00010000:00010000:0.0:1789601572.913544:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd89c6df/0x74872e3eca9f223e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d89 expref: 8 pid: 8857 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.913584:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1876532918377472:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601572.913604:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913613:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913633:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913652:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913660:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913668:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913676:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601572.913680:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913690:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913702:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.913710:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007666e145/0x74872e3eca9f225a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.913778:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898389504:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 17281us (17546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601572.913786:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:2.0:1789601572.922697:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.928189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898389888 00000100:00100000:3.0:1789601572.928210:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898389888 00000100:00100000:3.0:1789601572.928277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:3.0:1789601572.928288:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+19:12388:x1876532898389888:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789601572.928368:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.928386:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.928396:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.928429:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.928443:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 19 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601572.928457:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0100e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918377600:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601572.928540:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601572.934653:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601572.934762:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0100e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918377600:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601572.934790:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.934930:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390016 00000100:00100000:2.0:1789601572.934938:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390016 00010000:00010000:2.0:1789601572.934976:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 20 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.935017:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:2.0:1789601572.935027:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:2416:x1876532898390016:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601572.935049:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601572.935057:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 20 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935069:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 20 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935092:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f20a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d12 expref: 20 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935109:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.935114:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935125:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935151:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935177:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601572.935234:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:2416:x1876532898390016:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 208us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601572.935242:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00010000:00010000:2.0:1789601572.935265:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935272:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935442:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935455:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935463:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935493:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.935507:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 19 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.935520:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918377728:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601572.935603:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.949949:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918377728:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601572.949980:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.964177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601572.964276:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390144 00000100:00100000:0.0:1789601572.964287:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390144 00010000:00010000:0.0:1789601572.964327:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601572.964369:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:0.0:1789601572.964379:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+20:2415:x1876532898390144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601572.964393:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601572.964400:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964415:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964436:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2222 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d74 expref: 20 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964450:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601572.964454:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964463:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964484:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.964581:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601572.964631:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+19:2415:x1876532898390144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 254us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601572.964638:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00010000:00010000:2.0:1789601572.965534:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.965546:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601572.966488:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789601572.967696:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789601572.967778:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789601572.967870:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876532918377856:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789601572.967940:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601572.968026:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.972059:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918377856 00000100:00100000:3.0:1789601572.972073:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918377856 00000100:00100000:3.0:1789601572.972143:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789601572.972153:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876532918377856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789601572.972306:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876532918377856:12345-0@lo:1000:mdt00_002.0 Request processed in 155us (4365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.972314:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789601572.974334:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789601572.974346:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df3c359ca80, transno 4294967316 00000100:00100000:2.0:1789601572.974365:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876532918377856:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789601572.974539:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789601572.974749:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876532918377984:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789601572.974806:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601572.974836:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fec840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601572.974985:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918377984 00000100:00100000:1.0:1789601572.974992:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918377984 00000100:00100000:1.0:1789601572.975055:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789601572.975065:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c32d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876532918377984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789601572.975185:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c32d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1876532918377984:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (378us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789601572.975211:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789601572.975948:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876532918377984:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789601572.975994:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976004:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976012:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976029:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.976195:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976212:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976228:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:2.0:1789601572.976232:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601572.976237:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976244:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2268 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976271:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976278:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976284:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976289:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601572.976292:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976298:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976318:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:2.0:1789601572.976321:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601572.976324:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976330:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f219d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976354:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976369:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976379:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976410:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.976425:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 22 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.976438:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918378112:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601572.976512:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601572.986029:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601572.986076:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390272 00000100:00100000:1.0:1789601572.986085:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390272 00010000:00010000:1.0:1789601572.986124:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 23 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.986157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1789601572.986166:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+23:2416:x1876532898390272:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601572.986180:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601572.986187:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 23 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986199:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 23 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986232:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601572.986238:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986248:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986256:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986274:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601572.986321:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+23:2416:x1876532898390272:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 155us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601572.986336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00010000:00010000:1.0:1789601572.986439:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f21b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d58 expref: 22 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.986453:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918378112:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601572.986474:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986483:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986488:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986501:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986507:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986514:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986519:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601572.986523:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986531:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986551:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601572.986578:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601572.986584:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986590:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f226f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986601:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986607:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986612:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986616:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601572.986619:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986624:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4c3bebc00) 00010000:00010000:1.0:1789601572.986633:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601572.986635:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.986641:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678200/0x74872e3eca9f2261 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601572.986787:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+21:12388:x1876532898389888:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 58501us (64098us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789601572.986795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00000020:00080000:1.0:1789601572.986799:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789601572.986895:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601572.986900:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601572.987411:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789601572.987421:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601572.996734:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601573.002302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390528 00000100:00100000:3.0:1789601573.002316:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390528 00000100:00100000:3.0:1789601573.002378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1789601573.002388:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0981450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:12388:x1876532898390528:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789601573.002648:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789601573.002680:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789601573.002711:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002726:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002736:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002751:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002758:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002764:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.002781:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601573.002870:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0981450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+23:12388:x1876532898390528:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 483us (6158us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789601573.002878:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000020:00080000:3.0:1789601573.002883:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789601573.005771:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601573.005786:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.005799:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601573.005803:0:7464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.005813:0:7464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.005830:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601573.005834:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789601573.005839:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.005845:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f2276 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.005860:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601573.005861:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601573.005863:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601573.006253:0:14610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789601573.006259:0:14610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601573.006286:0:14610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789601573.006292:0:14610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601573.188130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.188395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390784 00000100:00100000:2.0:1789601573.188407:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390784 00000100:00100000:2.0:1789601573.188482:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:2.0:1789601573.188492:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+23:12398:x1876532898390784:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601573.188513:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601573.188532:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f227d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d90 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789601573.188592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601573.188650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2284 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.188665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.188678:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601573.188689:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789601573.188784:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f227d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d90 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.188799:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d90 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.188809:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601573.188812:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601573.188816:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383c00, rc 0) 00000100:00100000:2.0:1789601573.188876:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+25:12398:x1876532898390784:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 385us (752us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789601573.188892:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:3.0:1789601573.190737:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918378240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.190809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601573.190907:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378240 00000100:00100000:1.0:1789601573.190915:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378240 00000100:00100000:1.0:1789601573.190959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789601573.190968:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918378240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191626:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918378496:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191670:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191692:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918379008:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191745:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918379520:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191764:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191787:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789601573.191793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918378624:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191812:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191827:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918379136:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191845:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918379648:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.191878:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.191910:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379008 00000100:00100000:0.0:1789601573.191915:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379008 00000100:00100000:0.0:1789601573.191953:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379520 00000100:00100000:0.0:1789601573.191956:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379520 00000100:00100000:0.0:1789601573.191970:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378624 00000100:00100000:0.0:1789601573.191973:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378624 00000100:00100000:0.0:1789601573.191988:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789601573.191995:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918379008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.192036:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918379008:12345-0@lo:400:kworker.0 Request processed in 41us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.192042:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789601573.192056:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789601573.192061:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918379520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.192088:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918379520:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.192101:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789601573.192114:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789601573.192119:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918378624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.192510:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918378240:12345-0@lo:400:kworker.0 Request processed in 1541us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.192518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789601573.192599:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.192616:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378496 00000100:00100000:1.0:1789601573.192620:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378496 00000100:00100000:1.0:1789601573.192646:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789601573.192652:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.192686:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918378496:12345-0@lo:400:kworker.0 Request processed in 35us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.192692:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789601573.192707:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898390912 00000100:00100000:1.0:1789601573.192717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898390912 00000100:00100000:1.0:1789601573.192740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:1.0:1789601573.192746:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+25:12398:x1876532898390912:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1789601573.192805:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192822:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192835:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192850:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192857:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192863:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192949:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192958:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.192965:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601573.193004:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193026:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193032:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193039:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193045:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.193049:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193056:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193068:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601573.193071:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.193075:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193081:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2292 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193095:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193101:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193107:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193118:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.193121:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193127:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193282:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.193286:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.193290:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193296:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193310:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193317:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193323:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193327:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efe00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.193330:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193335:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193425:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9600) 00010000:00010000:1.0:1789601573.193428:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.193431:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.193436:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.193496:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+25:12398:x1876532898390912:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 749us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.193503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:1.0:1789601573.193527:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379136 00000100:00100000:1.0:1789601573.193531:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379136 00000100:00100000:1.0:1789601573.193569:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379648 00000100:00100000:1.0:1789601573.193573:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379648 00000100:00100000:1.0:1789601573.193595:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789601573.193601:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.193645:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918379136:12345-0@lo:400:kworker.0 Request processed in 44us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.193651:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789601573.193661:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789601573.193666:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918379648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.193693:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918379648:12345-0@lo:400:kworker.0 Request processed in 27us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.193699:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789601573.194000:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918378624:12345-0@lo:400:kworker.0 Request processed in 1879us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.194008:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789601573.194064:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918378624:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.194077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918379136:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.194086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918379648:0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.194096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918378496:0@lo:400:kworker.0 00010000:00080000:0.0:1789601573.194109:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c410df80 x1876532918379008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601573.194119:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918379008:0@lo:400:kworker.0 00010000:00080000:0.0:1789601573.194130:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c359c000 x1876532918379520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601573.194224:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918379520:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918378240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918378752:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195637:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601573.195682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918379264:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601573.195858:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789601573.195866:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918378368:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601573.195914:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918378880:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195944:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601573.195962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918379392:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.195981:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.196077:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378752 00000100:00100000:0.0:1789601573.196084:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378752 00000100:00100000:0.0:1789601573.196121:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789601573.196129:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918378752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601573.196186:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918378752:12345-0@lo:400:kworker.0 Request processed in 57us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.196212:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789601573.201816:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379264 00000100:00100000:1.0:1789601573.201832:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379264 00000100:00100000:1.0:1789601573.201914:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789601573.201924:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876532918379264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.202012:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876532918379264:12345-0@lo:400:kworker.0 Request processed in 90us (6305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.202019:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789601573.202250:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378368 00000100:00100000:3.0:1789601573.202256:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378368 00000100:00100000:3.0:1789601573.202381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918378880 00000100:00100000:3.0:1789601573.202385:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918378880 00000100:00100000:3.0:1789601573.202406:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918379392 00000100:00100000:3.0:1789601573.202408:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918379392 00000100:00100000:3.0:1789601573.202423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789601573.202429:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918378368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.202469:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918378368:12345-0@lo:400:kworker.0 Request processed in 40us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601573.202476:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789601573.202489:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789601573.202495:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.202523:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918378880:12345-0@lo:400:kworker.0 Request processed in 28us (6578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601573.202528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789601573.202541:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789601573.202546:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.206916:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918379392:12345-0@lo:400:kworker.0 Request processed in 4359us (10923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601573.206930:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:3.0:1789601573.206972:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601573.206979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601573.206982:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601573.207002:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601573.207059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918378368:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.207074:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918378880:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.207085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918379392:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.207097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918378752:0@lo:400:kworker.0 00000100:00100000:3.0:1789601573.207109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918379264:0@lo:400:kworker.0 00000100:00100000:1.0:1789601573.248339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.248374:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898391168 00000100:00100000:1.0:1789601573.248384:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898391168 00000100:00100000:1.0:1789601573.248434:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:1.0:1789601573.248444:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+25:12401:x1876532898391168:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601573.248464:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.248501:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d97 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248592:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248607:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.248646:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.250691:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.250712:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251118:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601573.251132:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789601573.251234:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251241:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251247:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251252:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.251256:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251264:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251276:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601573.251278:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.251283:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251302:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251317:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251323:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251329:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251334:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.251337:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251343:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251350:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4f8af9600) 00010000:00010000:1.0:1789601573.251353:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.251356:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251361:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251426:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.251440:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.251443:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601573.251446:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601573.251517:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+27:12401:x1876532898391168:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3074us (3189us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789601573.251527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:1.0:1789601573.263766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.264167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898391296 00000100:00100000:0.0:1789601573.264177:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898391296 00000100:00100000:0.0:1789601573.264244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:0.0:1789601573.264255:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+27:12401:x1876532898391296:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789601573.264318:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264337:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264349:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264386:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264393:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264399:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264405:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601573.264409:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264416:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264427:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:0.0:1789601573.264443:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601573.264449:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.264455:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f22ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601573.264524:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+27:12401:x1876532898391296:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 271us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.264532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:3.0:1789601573.272335:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601573.272369:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898391552 00000100:00100000:3.0:1789601573.272378:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898391552 00000100:00100000:3.0:1789601573.272427:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:3.0:1789601573.272437:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+27:12401:x1876532898391552:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601573.272669:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+28:12401:x1876532898391552:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 233us (344us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789601573.272676:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1789601573.323604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.323646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898391808 00000100:00100000:1.0:1789601573.323656:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898391808 00000100:00100000:1.0:1789601573.323722:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:1.0:1789601573.323732:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+28:11934:x1876532898391808:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601573.323757:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.323778:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48d9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.323929:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.323945:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.323954:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.323989:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.324015:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 29 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.324030:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918379776:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601573.324144:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601573.332450:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.333100:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898391936 00000100:00100000:0.0:1789601573.333110:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898391936 00010000:00010000:0.0:1789601573.333156:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601573.333216:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:0.0:1789601573.333227:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+30:2416:x1876532898391936:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601573.333242:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601573.333250:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.333636:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918379776:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601573.333664:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.333747:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.333775:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d97 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.333793:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:0.0:1789601573.333812:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.333822:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.333829:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.333913:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601573.333974:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+29:2416:x1876532898391936:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 749us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.333983:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00010000:00010000:2.0:1789601573.334466:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.334476:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601573.334496:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789601573.334639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f22d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.334657:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.334665:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:2.0:1789601573.334668:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601573.334670:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eec00, rc 0) 00000100:00100000:2.0:1789601573.334699:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:11934:x1876532898391808:12345-192.168.203.48@tcp:101:bash.0 Request processed in 10969us (11145us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789601573.334707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:0.0:1789601573.346234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.346860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392064 00000100:00100000:1.0:1789601573.346871:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392064 00000100:00100000:1.0:1789601573.346937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:1.0:1789601573.346947:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+29:11934:x1876532898392064:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601573.346971:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.346991:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48da5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347025:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347115:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347149:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347270:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f22e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48da5 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347289:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48da5 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.347298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.347301:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601573.347304:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601573.347791:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+30:11934:x1876532898392064:12345-192.168.203.48@tcp:101:bash.0 Request processed in 843us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.347799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:0.0:1789601573.353707:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601573.353794:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392320 00000100:00100000:3.0:1789601573.353805:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392320 00000100:00100000:3.0:1789601573.353869:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:3.0:1789601573.353881:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+30:11934:x1876532898392320:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:3.0:1789601573.354257:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.354275:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.354287:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601573.354350:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789601573.354371:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051ed489f reply state 000000008d24d4e7 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.354384:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.354392:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:3.0:1789601573.354395:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601573.354399:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789601573.354439:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789601573.355667:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+34:11934:x1876532898392320:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1781us (1961us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789601573.355678:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 207 00000020:00080000:3.0:1789601573.355684:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789601573.360151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.360266:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392448 00000100:00100000:0.0:1789601573.360275:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392448 00000100:00100000:0.0:1789601573.360386:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:0.0:1789601573.360397:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+34:11934:x1876532898392448:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601573.360423:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601573.360443:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f22fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dac expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.360501:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f22fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dac expref: 35 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.360517:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f22fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dac expref: 35 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.360536:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:0.0:1789601573.360540:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601573.360544:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466e00, rc 0) 00000100:00100000:0.0:1789601573.360642:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+35:11934:x1876532898392448:12345-192.168.203.48@tcp:101:bash.0 Request processed in 246us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.360664:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:3.0:1789601573.363007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.363167:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392576 00000100:00100000:2.0:1789601573.363176:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392576 00000100:00100000:2.0:1789601573.363243:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:2.0:1789601573.363254:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f776f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:11934:x1876532898392576:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601573.363272:0:8857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601573.363295:0:8857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48db3 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601573.363334:0:8857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab2723, atime: 0x6aab2721, ctime: 0x6aab2723, blocks: 0x8 00010000:00010000:2.0:1789601573.363355:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1789601573.363359:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601573.363367:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.363383:0:8857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.363396:0:8857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:2.0:1789601573.363448:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f776f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:11934:x1876532898392576:12345-192.168.203.48@tcp:101:bash.0 Request processed in 196us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601573.363456:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:2.0:1789601573.366387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.366490:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392704 00000100:00100000:0.0:1789601573.366500:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392704 00002000:00010000:0.0:1789601573.366543:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1789601573.366548:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c433fb80 with x1876532898392704 ext(0->18446744073709551615) 00002000:00010000:0.0:1789601573.366584:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c433fb80. 00000100:00100000:0.0:1789601573.366657:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1789601573.366668:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898392704:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:0.0:1789601573.367021:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789601573.367025:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789601571 -> 1789601573 00002000:00010000:0.0:1789601573.367028:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789601569 -> 1789601569 00002000:00010000:0.0:1789601573.367105:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789601571 -> 1789601573 00002000:00010000:0.0:1789601573.367109:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789601573.367232:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898392704:12345-192.168.203.48@tcp:10:bash.0 Request processed in 565us (854us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789601573.367240:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00002000:00010000:0.0:1789601573.367244:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1789601573.367247:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c433fb80 with x1876532898392704 ext(0->18446744073709551615) 00002000:00010000:0.0:1789601573.367252:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c433fb80. 00000100:00100000:2.0:1789601573.430847:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.430948:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898392832 00000100:00100000:1.0:1789601573.430959:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898392832 00000100:00100000:1.0:1789601573.431015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:1.0:1789601573.431024:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:12415:x1876532898392832:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1789601573.431101:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431119:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431161:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431175:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431259:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431269:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431276:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601573.431324:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431334:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431341:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431349:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431354:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.431358:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431371:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431382:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601573.431386:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.431391:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2309 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431412:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431419:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431425:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431430:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.431433:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431440:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431446:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4f8af9600) 00010000:00010000:1.0:1789601573.431449:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.431452:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431467:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2310 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431481:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431487:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431493:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431499:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.431502:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431508:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.431518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.431521:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.431527:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.431795:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+35:12415:x1876532898392832:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 769us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.431804:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:1.0:1789601573.472844:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.472964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898393088 00000100:00100000:0.0:1789601573.472984:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898393088 00000100:00100000:0.0:1789601573.473095:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:0.0:1789601573.473108:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+35:12418:x1876532898393088:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601573.473133:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601573.473154:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f231e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dba expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473257:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473272:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473282:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473296:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473303:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473309:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473416:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473425:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601573.473432:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601573.473441:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789601573.475950:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.475967:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.475974:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.475980:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601573.475985:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476008:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476023:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601573.476092:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601573.476099:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476105:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f2325 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476122:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476127:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476133:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476138:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601573.476141:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476146:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476154:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4c2e8b300) 00010000:00010000:2.0:1789601573.476156:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601573.476159:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476174:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467c00/0x74872e3eca9f232c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476248:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f231e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dba expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476264:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dba expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.476272:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:2.0:1789601573.476275:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601573.476278:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467200, rc 0) 00000100:00100000:2.0:1789601573.476365:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+37:12418:x1876532898393088:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3260us (3537us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789601573.476375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:2.0:1789601573.480005:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.480956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898393216 00000100:00100000:1.0:1789601573.480967:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898393216 00000100:00100000:1.0:1789601573.481230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:1.0:1789601573.481245:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+37:12418:x1876532898393216:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789601573.481314:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.481330:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.481338:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.481371:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.481384:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 37 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.481397:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918379904:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601573.481579:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601573.487081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601573.487229:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898393472 00000100:00100000:3.0:1789601573.487240:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898393472 00000100:00100000:3.0:1789601573.487300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1789601573.487310:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+38:6187:x1876532898393472:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789601573.487624:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+39:6187:x1876532898393472:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 315us (550us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789601573.487632:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789601573.487926:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918379904:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601573.487952:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601573.493660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.493898:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898393600 00000100:00100000:1.0:1789601573.493909:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898393600 00010000:00010000:1.0:1789601573.493966:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 39 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601573.494006:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:1.0:1789601573.494016:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+39:2415:x1876532898393600:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601573.494039:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601573.494047:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 39 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494061:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 39 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494082:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f22d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d9e expref: 39 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494100:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.494105:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494114:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494122:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.494157:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601573.494221:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+38:2415:x1876532898393600:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 206us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.494228:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00010000:00010000:2.0:1789601573.496988:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497007:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497064:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497072:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497080:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497106:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601573.497111:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497120:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497136:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:2.0:1789601573.497139:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601573.497144:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.497150:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f2341 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601573.497272:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+37:12418:x1876532898393216:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 16025us (17269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601573.497282:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:3.0:1789601573.500450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601573.500612:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898393856 00000100:00100000:0.0:1789601573.500622:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898393856 00000100:00100000:0.0:1789601573.500705:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1789601573.500724:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+37:12418:x1876532898393856:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789601573.501900:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+38:12418:x1876532898393856:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 1182us (1456us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789601573.501911:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00010000:00010000:1.0:1789601573.510255:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601573.645792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.645910:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898394112 00000100:00100000:1.0:1789601573.645919:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898394112 00000100:00100000:1.0:1789601573.645984:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:1.0:1789601573.645995:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+38:12429:x1876532898394112:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:1.0:1789601573.646017:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.646044:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dc1 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646116:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646130:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646154:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646169:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646177:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646183:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646301:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f235d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646312:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f235d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646340:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f235d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601573.646350:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789601573.646501:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646510:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646517:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646523:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.646527:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646535:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646548:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601573.646551:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.646623:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646632:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f234f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646646:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646652:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646667:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646672:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.646675:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646681:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646689:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df4f8af9600) 00010000:00010000:1.0:1789601573.646692:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.646695:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646701:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f2356 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646746:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc1 expref: 41 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646760:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f235d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc1 expref: 40 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.646767:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:1.0:1789601573.646769:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601573.646772:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:1.0:1789601573.646838:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+40:12429:x1876532898394112:12345-192.168.203.48@tcp:101:cat.0 Request processed in 845us (1055us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789601573.646856:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:3.0:1789601573.655420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.655545:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898394368 00000100:00100000:2.0:1789601573.655604:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898394368 00000100:00100000:2.0:1789601573.655662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:2.0:1789601573.655671:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+40:12429:x1876532898394368:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:2.0:1789601573.655992:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+41:12429:x1876532898394368:12345-192.168.203.48@tcp:35:cat.0 Request processed in 321us (581us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789601573.655999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1789601573.697418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.697595:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898394624 00000100:00100000:2.0:1789601573.697606:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898394624 00000100:00100000:2.0:1789601573.697721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:2.0:1789601573.697738:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+41:12430:x1876532898394624:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:2.0:1789601573.697795:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789601573.697822:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f22fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dac expref: 41 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697844:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f235d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc1 expref: 40 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697855:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dba expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697866:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f22ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48da5 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697874:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:2.0:1789601573.697879:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601573.697910:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697923:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697934:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697950:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697957:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.697972:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698077:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698086:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698093:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601573.698306:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789601573.698316:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441819758812ns, next at 442819756070ns, rc = 0 00010000:00010000:2.0:1789601573.698359:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698369:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698383:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698391:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698396:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698432:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601573.698451:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698457:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698463:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698481:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601573.698486:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698493:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698502:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:2.0:1789601573.698505:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789601573.698509:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2379 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698530:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698535:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698540:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698550:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601573.698553:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698616:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698625:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601573.698627:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601573.698630:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698637:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f236b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601573.698646:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000307c7b6c reply state 0000000038a4e338 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698657:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.698664:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:2.0:1789601573.698666:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601573.698669:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601573.698733:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+39:12430:x1876532898394624:12345-192.168.203.48@tcp:36:rm.0 Request processed in 995us (1322us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789601573.698742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 213 00010000:00010000:3.0:1789601573.698966:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601573.698973:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.698980:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601573.698984:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.698990:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.699000:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:3.0:1789601573.699006:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789601573.699010:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.699016:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2380 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.699029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601573.699031:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601573.699032:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601573.701783:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601573.706913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918380160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601573.707010:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601573.707239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918380032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601573.707268:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601573.713979:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918380160 00000100:00100000:0.0:1789601573.713999:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918380160 00000100:00100000:0.0:1789601573.714057:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918380032 00000100:00100000:0.0:1789601573.714061:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918380032 00000100:00100000:0.0:1789601573.714080:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789601573.714088:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918380160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601573.714131:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601573.714222:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918380160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (7211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.714228:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789601573.714244:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789601573.714251:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918380032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601573.714262:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601573.714287:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918380032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (7018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601573.714294:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789601573.714495:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918380160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601573.714511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918380032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601573.770348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.770867:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898394880 00000100:00100000:1.0:1789601573.770877:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898394880 00000100:00100000:1.0:1789601573.771203:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:1.0:1789601573.771216:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+39:12436:x1876532898394880:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601573.771242:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.771262:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2387 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dc8 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771362:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771378:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771390:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771401:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771408:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.771414:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601573.771980:0:9040:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789601573.772290:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772318:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772327:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772362:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772370:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772377:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772382:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73efc00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601573.772386:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772394:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772404:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601573.772408:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601573.772412:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772418:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f238e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601573.772433:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c529f61f reply state 0000000000d5fd1e transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772451:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.772456:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:1.0:1789601573.772459:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601573.772461:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789601573.773342:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2387 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 42 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.773362:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 41 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.773369:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601573.773372:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601573.773374:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73eee00, rc 0) 00000100:00100000:1.0:1789601573.773448:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+42:12436:x1876532898394880:12345-192.168.203.48@tcp:101:bash.0 Request processed in 2235us (3109us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789601573.773457:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:0.0:1789601573.778502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601573.778599:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395008 00000100:00100000:1.0:1789601573.778610:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395008 00000100:00100000:1.0:1789601573.778683:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:1.0:1789601573.778694:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898395008:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789601573.778721:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601573.778743:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dcf expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601573.778772:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601573.778814:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789601573.778818:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601573.778828:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.778849:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601573.778862:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:1.0:1789601573.778933:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898395008:12345-192.168.203.48@tcp:101:bash.0 Request processed in 242us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.778940:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00080000:3.0:1789601573.780083:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601573.783242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.783353:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395136 00000100:00100000:2.0:1789601573.783363:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395136 00000100:00100000:2.0:1789601573.783452:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1789601573.783462:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+8:12436:x1876532898395136:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601573.783489:0:8857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601573.783507:0:8857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48dd6 expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.783538:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.783546:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601573.783550:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601573.783732:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 9 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.783768:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.783782:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 9 pid: 8441 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601573.783813:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8857:1876532918380288:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601573.783951:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601573.787779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601573.787918:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395264 00000100:00100000:3.0:1789601573.787929:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395264 00010000:00010000:3.0:1789601573.787972:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 10 pid: 8441 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601573.788020:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:3.0:1789601573.788038:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+10:2415:x1876532898395264:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601573.788269:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601573.788291:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 10 pid: 8441 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.788308:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 10 pid: 8441 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.788333:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601573.788338:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601573.788347:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 10 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.788358:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 10 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601573.788397:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 10 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601573.788411:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876532918380416:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789601573.788504:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b80c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789601573.789298:0:8857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd89c6df/0x74872e3eca9f23aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dcf expref: 10 pid: 8441 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601573.789318:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8857:1876532918380288:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601573.789344:0:8857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 9 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601573.789357:0:8857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030600, rc 0) 00000100:00100000:2.0:1789601573.789391:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:12436:x1876532898395136:12345-192.168.203.48@tcp:101:bash.0 Request processed in 5930us (6159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601573.789399:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1789601573.793398:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876532918380416:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789601573.793424:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601573.793483:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898395264:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 5454us (5714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601573.793494:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:0.0:1789601573.798322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601573.798414:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395520 00000100:00100000:2.0:1789601573.798424:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395520 00000100:00100000:2.0:1789601573.798482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1789601573.798493:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+42:12436:x1876532898395520:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:2.0:1789601573.798840:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+43:12436:x1876532898395520:12345-192.168.203.48@tcp:35:bash.0 Request processed in 348us (526us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789601573.798848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789601574.046893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.047058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395648 00000100:00100000:1.0:1789601574.047068:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395648 00000100:00100000:1.0:1789601574.047129:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:1.0:1789601574.047139:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+43:12452:x1876532898395648:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601574.047162:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601574.047182:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f23b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ddd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047255:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047282:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047296:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601574.047339:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789601574.047343:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789601574.047363:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047389:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f23b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ddd expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047408:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ddd expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.047418:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601574.047420:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601574.047423:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efc00, rc 0) 00000100:00100000:1.0:1789601574.047537:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+44:12452:x1876532898395648:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 399us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.047544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:0.0:1789601574.057874:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.058462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898395904 00000100:00100000:2.0:1789601574.058672:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898395904 00000100:00100000:2.0:1789601574.058837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:2.0:1789601574.058863:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+44:12452:x1876532898395904:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601574.058896:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601574.058923:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f23c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48de4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.059207:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f23cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.059223:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f23cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.059235:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f23cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601574.059248:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789601574.059363:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f23c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48de4 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.059386:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f23cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48de4 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.059395:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:2.0:1789601574.059398:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601574.059402:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030c00, rc 0) 00000100:00100000:2.0:1789601574.059479:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+46:12452:x1876532898395904:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 608us (1604us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789601574.059486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:0.0:1789601574.068977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.069223:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396032 00000100:00100000:1.0:1789601574.069233:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396032 00000100:00100000:1.0:1789601574.069301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789601574.069311:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3638c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+46:2415:x1876532898396032:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601574.069326:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601574.069364:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f23cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48de4 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.069385:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601574.069391:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.069439:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3638c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+45:2415:x1876532898396032:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 130us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.069447:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789601574.076520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.076642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396288 00000100:00100000:1.0:1789601574.076651:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396288 00000100:00100000:1.0:1789601574.076702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:1.0:1789601574.076723:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+45:12452:x1876532898396288:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601574.076746:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601574.076765:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f23db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48deb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.076861:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.076876:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.076888:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601574.076912:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789601574.077008:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f23db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48deb expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.077342:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48deb expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.077351:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601574.077354:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789601574.077357:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef000, rc 0) 00000100:00100000:0.0:1789601574.078539:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+47:12452:x1876532898396288:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1812us (2022us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789601574.078550:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:0.0:1789601574.092375:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.092488:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396416 00000100:00100000:1.0:1789601574.092502:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396416 00000100:00100000:1.0:1789601574.092618:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1789601574.092629:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898396416:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:1.0:1789601574.092671:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.092702:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.092719:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789601574.092723:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601574.092727:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.092760:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.092784:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 8 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.092817:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918380544:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601574.093517:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601574.099411:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.099871:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1876532918380544:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601574.099910:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.100276:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396544 00000100:00100000:2.0:1789601574.100283:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396544 00002000:00100000:2.0:1789601574.100343:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8df3c36ab100 x1876532898396544/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:170/0 lens 504/0 e 0 to 0 dl 1789601585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601574.100352:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36ab100 with x1876532898396544 ext(0->8) 00010000:00010000:2.0:1789601574.100360:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 9 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.100373:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 9 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601574.100381:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c36ab100 00000100:00100000:2.0:1789601574.100413:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601574.100421:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+9:2415:x1876532898396544:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:2.0:1789601574.102622:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+11:2415:x1876532898396544:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 2190us (3208us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789601574.102634:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:2.0:1789601574.102646:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8df3c36ab100 x1876532898396544/t4294967309(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:170/0 lens 504/448 e 0 to 0 dl 1789601585 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601574.102657:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36ab100 with x1876532898396544 ext(0->8) 00010000:00010000:2.0:1789601574.102667:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.102695:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601574.102703:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df3c36ab100 00000100:00100000:0.0:1789601574.109306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.109452:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396672 00000100:00100000:1.0:1789601574.109462:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396672 00010000:00010000:1.0:1789601574.109515:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.109597:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:1.0:1789601574.109608:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+11:2416:x1876532898396672:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601574.109623:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789601574.109641:0:7465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789601574.109644:0:7465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789601573 00002000:00010000:1.0:1789601574.109647:0:7465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789601573 00002000:00010000:1.0:1789601574.109649:0:7465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789601573 00002000:00010000:1.0:1789601574.109652:0:7465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789601574.109659:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.109674:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.109731:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000282c8d67/0x74872e3eca9f23b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dd6 expref: 11 pid: 8857 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.109750:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601574.109755:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601574.109760:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.109770:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.109816:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.109867:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+10:2416:x1876532898396672:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 260us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.109875:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00010000:00010000:2.0:1789601574.112410:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112428:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112458:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112467:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112486:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112493:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601574.112498:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112507:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112525:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.112533:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f23f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.112688:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+9:2417:x1876532898396416:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 20057us (20318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.112697:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789601574.128971:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.129664:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898396928 00000100:00100000:2.0:1789601574.129674:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898396928 00000100:00100000:0.0:1789601574.130186:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1789601574.130209:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0982450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+47:12452:x1876532898396928:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:0.0:1789601574.130273:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48deb expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601574.130447:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789601574.130495:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789601574.130834:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789601574.130874:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.130890:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 51 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.131035:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.131213:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 51 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.131230:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 51 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601574.131261:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876532918380672:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601574.131358:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601574.139896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.140879:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397056 00000100:00100000:1.0:1789601574.140889:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397056 00010000:00010000:1.0:1789601574.141185:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 52 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.141242:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:1.0:1789601574.141253:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+52:2416:x1876532898397056:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601574.141269:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601574.141277:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 52 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.141309:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 52 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.141331:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601574.141336:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.141346:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.141353:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.141372:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.141486:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+52:2416:x1876532898397056:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 234us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.141494:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00010000:00010000:2.0:1789601574.142426:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f239c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48dc8 expref: 51 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.142448:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876532918380672:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601574.142470:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.142480:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.142486:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601574.142638:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789601574.142763:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789601574.142856:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918380800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789601574.143429:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601574.143515:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601574.145358:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918380800 00000100:00100000:1.0:1789601574.145372:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918380800 00000100:00100000:1.0:1789601574.145508:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789601574.145518:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1876532918380800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789601574.145668:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1876532918380800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 151us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.145676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789601574.145842:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918380800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789601574.146015:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789601574.146350:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918380928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789601574.146409:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601574.146430:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601574.146492:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918380928 00000100:00100000:1.0:1789601574.146498:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918380928 00000100:00100000:1.0:1789601574.146541:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789601574.146550:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876532918380928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789601574.146698:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1876532918380928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 149us (289us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789601574.147592:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789601574.147658:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876532918380928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789601574.148002:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789601574.148188:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148210:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148219:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148225:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601574.148229:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148236:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148252:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601574.148255:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789601574.148260:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.148267:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f23f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601574.148390:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789601574.148790:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789601574.148808:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442270250633ns, next at 443270247497ns, rc = 0 00000001:00080000:1.0:1789601574.148815:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1789601574.148846:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dde00) 00010000:00010000:1.0:1789601574.148849:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789601574.148857:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f23e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48deb expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789601574.149253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601574.149374:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0982450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+54:12452:x1876532898396928:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 19177us (20410us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789601574.149384:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000020:00080000:1.0:1789601574.149389:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789601574.153669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.153858:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397184 00000100:00100000:1.0:1789601574.153869:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397184 00000100:00100000:1.0:1789601574.153942:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:1.0:1789601574.153953:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+54:12452:x1876532898397184:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601574.153974:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601574.153997:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f23fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48df2 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.154063:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f23fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df2 expref: 55 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.154080:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f23fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df2 expref: 55 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.154099:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.154103:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601574.154122:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:1.0:1789601574.154185:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+55:12452:x1876532898397184:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 233us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.154201:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:0.0:1789601574.158379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601574.158463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397440 00000100:00100000:3.0:1789601574.158482:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397440 00000100:00100000:3.0:1789601574.158546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789601574.158592:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+55:12452:x1876532898397440:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601574.158800:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+56:12452:x1876532898397440:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 245us (429us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789601574.158807:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789601574.292867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.293308:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397568 00000100:00100000:2.0:1789601574.293318:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397568 00000100:00100000:2.0:1789601574.293419:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:2.0:1789601574.293430:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+56:12463:x1876532898397568:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789601574.293516:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293536:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293549:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293587:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293595:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293603:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293680:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293689:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293697:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601574.293775:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293789:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293796:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293802:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293808:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601574.293812:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293819:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293831:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601574.293834:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601574.293839:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293846:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293860:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293866:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293879:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293884:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601574.293888:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.293894:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294527:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:2.0:1789601574.294530:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601574.294534:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294541:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f240c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294554:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294614:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294620:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294626:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601574.294629:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294649:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294657:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601574.294660:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601574.294663:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.294669:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.294827:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+56:12463:x1876532898397568:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1396us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.294836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:0.0:1789601574.337507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.337626:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397824 00000100:00100000:1.0:1789601574.337637:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397824 00000100:00100000:1.0:1789601574.337701:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:1.0:1789601574.337722:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+56:12466:x1876532898397824:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601574.337742:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601574.337762:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f241a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48df9 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337836:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337851:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337865:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337878:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337887:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.337894:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338011:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338036:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338045:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601574.338057:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789601574.338136:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338144:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338151:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338157:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601574.338160:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338167:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338179:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601574.338182:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601574.338186:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338201:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eee00/0x74872e3eca9f2421 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338216:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338228:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338234:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338239:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601574.338242:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338247:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338256:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:1.0:1789601574.338258:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601574.338262:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338268:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73eec00/0x74872e3eca9f2428 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338305:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef000/0x74872e3eca9f241a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 59 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338320:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 58 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.338327:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.338329:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601574.338338:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e0e00, rc 0) 00000100:00100000:1.0:1789601574.338401:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+58:12466:x1876532898397824:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 681us (901us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789601574.338408:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:3.0:1789601574.343101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.343217:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898397952 00000100:00100000:0.0:1789601574.343228:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898397952 00000100:00100000:0.0:1789601574.343287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:0.0:1789601574.343297:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+58:12466:x1876532898397952:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789601574.343361:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343378:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343390:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343425:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343433:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343440:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343461:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601574.343466:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343487:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343499:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601574.343502:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601574.343507:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.343513:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f243d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601574.343615:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+58:12466:x1876532898397952:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 320us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601574.343623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:0.0:1789601574.348014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601574.348100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898398208 00000100:00100000:3.0:1789601574.348110:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898398208 00000100:00100000:3.0:1789601574.348166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1789601574.348177:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+58:12466:x1876532898398208:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601574.348417:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+59:12466:x1876532898398208:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 242us (410us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789601574.348425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:1.0:1789601574.446087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.446217:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898398464 00000100:00100000:0.0:1789601574.446227:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898398464 00000100:00100000:0.0:1789601574.446309:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:0.0:1789601574.446320:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+59:12476:x1876532898398464:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601574.446342:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601574.446345:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789601574.446370:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efc00/0x74872e3eca9f23bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ddd expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446412:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601574.446417:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601574.446430:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f2444 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e00 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446534:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446549:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 59 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446614:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446648:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 59 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.446662:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 59 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601574.446677:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918381056:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601574.446777:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601574.451711:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.451869:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918381056:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601574.451899:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.452149:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898398592 00000100:00100000:2.0:1789601574.452157:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898398592 00010000:00010000:2.0:1789601574.452208:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 60 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601574.452248:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:2.0:1789601574.452257:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+60:2418:x1876532898398592:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601574.452272:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601574.452279:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 60 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452291:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 60 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452337:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f242f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df9 expref: 60 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452354:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601574.452358:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452367:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452375:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.452405:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601574.452458:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+59:2418:x1876532898398592:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 201us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.452465:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00010000:00010000:1.0:1789601574.452690:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.452698:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601574.452715:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789601574.452835:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f2444 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 60 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.452850:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 59 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.452856:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.452859:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601574.452861:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467200, rc 0) 00000100:00100000:1.0:1789601574.452894:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+59:12476:x1876532898398464:12345-192.168.203.48@tcp:101:bash.0 Request processed in 6576us (6817us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789601574.452901:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:0.0:1789601574.454884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.454970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898398720 00000100:00100000:2.0:1789601574.454983:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898398720 00000100:00100000:2.0:1789601574.455072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:2.0:1789601574.455085:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e1f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+59:12476:x1876532898398720:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789601574.455121:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601574.455145:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2459 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e07 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455204:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455243:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455257:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455392:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2459 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455415:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.455424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601574.455427:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789601574.455432:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031c00, rc 0) 00000100:00100000:2.0:1789601574.455517:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e1f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+60:12476:x1876532898398720:12345-192.168.203.48@tcp:101:bash.0 Request processed in 436us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.455526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:0.0:1789601574.469642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.471770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898398976 00000100:00100000:2.0:1789601574.471786:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898398976 00000100:00100000:2.0:1789601574.471853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:2.0:1789601574.471864:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+60:12476:x1876532898398976:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:2.0:1789601574.472083:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.472102:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.472143:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601574.472184:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789601574.472217:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000536cda28 reply state 000000008da61499 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.472229:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.472237:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601574.472241:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601574.472245:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601574.472526:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+63:12476:x1876532898398976:12345-192.168.203.48@tcp:36:bash.0 Request processed in 663us (2898us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789601574.472535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 224 00000020:00080000:2.0:1789601574.472540:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789601574.485785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.487856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898399104 00000100:00100000:1.0:1789601574.487893:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898399104 00000100:00100000:0.0:1789601574.489390:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:0.0:1789601574.489426:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+63:12476:x1876532898399104:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789601574.489459:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601574.489488:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f246e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e0e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.489655:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.489675:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.489685:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.489740:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 64 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.489756:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 64 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601574.489773:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918381184:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601574.489889:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d94cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601574.493490:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.493589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898399232 00000100:00100000:1.0:1789601574.493603:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898399232 00010000:00010000:1.0:1789601574.493660:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 65 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.493721:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1789601574.493733:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+65:2416:x1876532898399232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601574.493749:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601574.493757:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 65 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.493772:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 65 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.493798:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.493804:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.493815:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.493825:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.493846:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.493915:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+65:2416:x1876532898399232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 185us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.493923:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00010000:00010000:0.0:1789601574.495481:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f244b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e00 expref: 64 pid: 9040 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601574.495514:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918381184:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601574.495541:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.495658:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.495664:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601574.495724:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789601574.495729:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601574.495751:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.495795:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f246e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.495810:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.495820:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601574.495824:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601574.495827:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467000, rc 0) 00000100:00100000:0.0:1789601574.495901:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+63:12476:x1876532898399104:12345-192.168.203.48@tcp:101:bash.0 Request processed in 6481us (10131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601574.495909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:3.0:1789601574.498690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.498799:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898399488 00000100:00100000:0.0:1789601574.498810:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898399488 00000100:00100000:0.0:1789601574.498857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:0.0:1789601574.498866:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+63:12476:x1876532898399488:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1789601574.499070:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+64:12476:x1876532898399488:12345-192.168.203.48@tcp:35:bash.0 Request processed in 204us (389us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789601574.499091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00010000:00010000:0.0:1789601574.537527:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601574.585208:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.585342:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898399616 00000100:00100000:0.0:1789601574.585352:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898399616 00000100:00100000:0.0:1789601574.585424:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:0.0:1789601574.585435:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+64:12482:x1876532898399616:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601574.585458:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601574.585478:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f247c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e15 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585544:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585607:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585622:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601574.585667:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789601574.585671:0:9040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601574.585689:0:9040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585727:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f247c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e15 expref: 66 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585745:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e15 expref: 65 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.585768:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601574.585771:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601574.585775:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467200, rc 0) 00000100:00100000:0.0:1789601574.585839:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898399616:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 405us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601574.585846:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:3.0:1789601574.592209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.592335:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898399744 00000100:00100000:2.0:1789601574.592353:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898399744 00000100:00100000:2.0:1789601574.592464:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 227 00000100:00100000:2.0:1789601574.592478:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898399744:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601574.592509:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601574.592538:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f248a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e1c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592665:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592684:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592717:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592731:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592739:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592746:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592844:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592854:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592861:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601574.592917:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789601574.592922:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601574.592946:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592960:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592970:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.592987:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593007:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593013:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601574.593019:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593027:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601574.593047:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601574.593052:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593059:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2491 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593078:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593085:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593092:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593098:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601574.593108:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593116:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593124:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:2.0:1789601574.593127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601574.593130:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593136:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2498 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593183:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f248a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593208:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.593217:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601574.593219:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601574.593222:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382200, rc 0) 00000100:00100000:2.0:1789601574.593313:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+66:12482:x1876532898399744:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 837us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.593321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 227 00000100:00100000:0.0:1789601574.604871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.604930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.605286:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400000 00000100:00100000:1.0:1789601574.605300:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400000 00000100:00100000:1.0:1789601574.605375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:1.0:1789601574.605388:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:12482:x1876532898400000:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601574.605418:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601574.605456:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f24a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605660:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605680:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605689:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605700:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605743:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605759:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.605777:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918381312:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601574.605901:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.605929:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.605939:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918381440:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601574.605967:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601574.607142:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400128 00000100:00100000:1.0:1789601574.607328:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400128 00010000:00010000:1.0:1789601574.607371:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 68 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.607415:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:1.0:1789601574.607424:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+68:2415:x1876532898400128:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601574.607642:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601574.607652:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 68 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.607667:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 68 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.607691:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.607697:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.607706:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.607729:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.607779:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+68:2415:x1876532898400128:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 355us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.607787:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:0.0:1789601574.610159:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1789601574.610785:0:6522:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.48@tcp) returned -22 from blocking AST (req@0000000044810a09 x1876532918381312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.610812:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f249f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e1c expref: 67 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601574.610832:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918381312:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601574.610849:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876532918381440:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601574.610877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.610882:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.610894:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.610904:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601574.611951:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400256 00000100:00100000:3.0:1789601574.611963:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400256 00010000:00010000:3.0:1789601574.613692:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601574.615462:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:3.0:1789601574.615489:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:2417:x1876532898400256:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601574.615636:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601574.615649:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615689:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615731:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2475 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e0e expref: 67 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615754:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601574.615762:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615773:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615781:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.615818:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601574.615894:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:2417:x1876532898400256:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 420us (5756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601574.615902:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 100 00010000:00010000:3.0:1789601574.616078:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.616088:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601574.616109:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789601574.618876:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0e00/0x74872e3eca9f24a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.618935:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601574.618948:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601574.618952:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601574.618956:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5021e1c00, rc 0) 00000100:00100000:3.0:1789601574.619057:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:12482:x1876532898400000:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 13670us (14201us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789601574.619067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:3.0:1789601574.624941:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601574.625047:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400512 00000100:00100000:1.0:1789601574.625062:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400512 00000100:00100000:1.0:1789601574.625144:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789601574.625176:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3638450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+66:12482:x1876532898400512:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:1.0:1789601574.625224:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601574.625257:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73efe00/0x74872e3eca9f23fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48df2 expref: 66 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601574.625291:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601574.625298:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601574.625375:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3638450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898400512:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 203us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601574.625384:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789601574.630347:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.630523:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400640 00000100:00100000:2.0:1789601574.630537:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400640 00000100:00100000:2.0:1789601574.630647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:2.0:1789601574.630660:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898400640:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789601574.630826:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.630851:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601574.630866:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601574.631841:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789601574.632013:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898400640:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 1353us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.632024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:2.0:1789601574.641667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601574.641811:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400768 00000100:00100000:0.0:1789601574.641825:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400768 00000100:00100000:0.0:1789601574.641899:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:0.0:1789601574.641912:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+65:12482:x1876532898400768:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601574.641939:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601574.641968:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e2a expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642613:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642627:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 66 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642649:0:9040:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642664:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 66 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642694:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601574.642697:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601574.642702:0:9040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 66 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601574.642710:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467a00, rc 0) 00000100:00100000:0.0:1789601574.642777:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+66:12482:x1876532898400768:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 867us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601574.642785:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:2.0:1789601574.692487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.692545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.692618:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.692652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.692671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601574.692701:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401280 00000100:00100000:2.0:1789601574.692712:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401280 00000100:00100000:2.0:1789601574.692782:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401152 00000100:00100000:2.0:1789601574.692786:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401152 00000100:00100000:2.0:1789601574.692813:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:2.0:1789601574.692826:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898401280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601574.692923:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898401280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.692932:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:2.0:1789601574.692969:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:2.0:1789601574.692977:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898401152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601574.693006:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898401152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601574.693012:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00080000:2.0:1789601574.693038:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601574.693073:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601574.693283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898400896 00000100:00100000:3.0:1789601574.693289:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898400896 00000100:00100000:3.0:1789601574.693325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 394 00000100:00100000:3.0:1789601574.693333:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898400896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601574.693363:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898400896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601574.693369:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 394 00000100:00100000:3.0:1789601574.693410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401024 00000100:00100000:3.0:1789601574.693414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401024 00000100:00100000:3.0:1789601574.693445:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401536 00000100:00100000:3.0:1789601574.693449:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401536 00000100:00100000:3.0:1789601574.693462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401408 00000100:00100000:3.0:1789601574.693465:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401408 00000100:00100000:3.0:1789601574.693482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 344 00000100:00100000:3.0:1789601574.693488:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898401024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601574.693529:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898401024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601574.693536:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 344 00000100:00100000:3.0:1789601574.693549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 345 00000100:00100000:3.0:1789601574.693578:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898401536:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601574.693605:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898401536:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 49us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601574.693611:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 345 00000100:00100000:3.0:1789601574.693624:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 346 00000100:00100000:3.0:1789601574.693631:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898401408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601574.693655:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898401408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601574.693661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 346 00000100:00080000:3.0:1789601574.693676:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601574.693680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789601575.046041:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601575.046051:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601575.046112:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789601575.046142:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601575.046317:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918381568:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601575.046524:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601575.060063:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918381568:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601575.060490:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.061478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401664 00000100:00100000:3.0:1789601575.061488:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401664 00000100:00100000:3.0:1789601575.061630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:3.0:1789601575.061642:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:12483:x1876532898401664:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601575.061672:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601575.061917:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:12483:x1876532898401664:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 276us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601575.061925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00080000:2.0:1789601575.065892:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601575.070703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.070877:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898401792 00000100:00100000:0.0:1789601575.070888:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898401792 00000100:00100000:0.0:1789601575.070968:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:0.0:1789601575.070979:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+66:12483:x1876532898401792:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789601575.071061:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071077:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071092:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071109:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071116:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071135:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071159:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071176:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601575.071231:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789601575.071236:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601575.071250:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071260:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071267:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071274:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071279:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.071283:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071290:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071307:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:0.0:1789601575.071310:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.071316:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071323:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f24c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071337:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071343:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071348:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071353:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.071356:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071362:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071369:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8df4c2e8b100) 00010000:00010000:0.0:1789601575.071370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.071373:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071379:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f24d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071405:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071411:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071417:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071422:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.071425:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071431:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071439:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601575.071441:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.071444:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.071449:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466400/0x74872e3eca9f24d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601575.071529:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+66:12483:x1876532898401792:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 551us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.071538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:0.0:1789601575.080473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.080595:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898402048 00000100:00100000:3.0:1789601575.080605:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898402048 00000100:00100000:3.0:1789601575.080663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 233 00000100:00100000:3.0:1789601575.080672:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+66:12483:x1876532898402048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601575.080700:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601575.080720:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f24de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080848:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080860:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601575.080870:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789601575.080948:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080956:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080963:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080969:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601575.080973:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.080981:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.081008:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601575.081011:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789601575.081016:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.081023:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f24e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.081076:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f24de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e31 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.081086:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:3.0:1789601575.081089:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601575.081092:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f24de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e31 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.081101:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678c00, rc 0) 00000100:00100000:3.0:1789601575.081165:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 494us (702us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789601575.081173:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 233 00000100:00100000:3.0:1789601575.089483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.089912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898402176 00000100:00100000:0.0:1789601575.089928:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898402176 00000100:00100000:0.0:1789601575.090198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:0.0:1789601575.090212:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402176:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789601575.090259:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789601575.090465:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402176:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 246us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.090474:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:0.0:1789601575.109405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.109527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898402432 00000100:00100000:1.0:1789601575.109541:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898402432 00000100:00100000:1.0:1789601575.109915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:1.0:1789601575.109929:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601575.109954:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601575.109958:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601575.112930:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467200/0x74872e3eca9f2483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e15 expref: 67 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.112985:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601575.112991:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601575.114510:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f24f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e38 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601575.115295:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789601575.115468:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f24fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.115486:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f24fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.115502:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f24fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.115611:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f24f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e38 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.115636:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f24fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e38 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.115646:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df3c341c400) 00010000:00010000:2.0:1789601575.115665:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601575.115670:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030000, rc 0) 00000100:00100000:2.0:1789601575.115929:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+68:12483:x1876532898402432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6001us (6537us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789601575.115939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:3.0:1789601575.125990:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.126122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898402688 00000100:00100000:0.0:1789601575.126137:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898402688 00000100:00100000:0.0:1789601575.126228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:0.0:1789601575.126240:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+68:12483:x1876532898402688:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789601575.126322:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601575.126362:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f24fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e38 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126388:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df3c341c400) 00010000:00010000:0.0:1789601575.126404:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601575.126433:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126452:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126466:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126483:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126510:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.126518:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127324:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127339:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127348:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127356:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.127361:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127370:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127383:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:0.0:1789601575.127386:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.127391:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127398:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466c00/0x74872e3eca9f2508 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127410:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127429:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127435:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127440:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.127443:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127517:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd0bcdd8b (ffff8df4c2e8b100) 00010000:00010000:0.0:1789601575.127521:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.127523:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.127529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466a00/0x74872e3eca9f250f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd0bcdd8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601575.127797:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402688:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1553us (1817us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601575.127807:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:3.0:1789601575.133989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.134085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898402816 00000100:00100000:0.0:1789601575.134097:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898402816 00000100:00100000:0.0:1789601575.134182:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:0.0:1789601575.134209:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+67:12483:x1876532898402816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601575.134235:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601575.134276:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2516 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134318:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134335:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134349:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134476:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f2516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134499:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.134510:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:0.0:1789601575.134514:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601575.134518:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466e00, rc 0) 00000100:00100000:0.0:1789601575.134632:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+68:12483:x1876532898402816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 426us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.134640:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:3.0:1789601575.139009:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.139956:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403072 00000100:00100000:2.0:1789601575.139971:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403072 00000100:00100000:2.0:1789601575.140089:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:2.0:1789601575.140102:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+68:12483:x1876532898403072:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.140553:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.140647:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.140660:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601575.140926:0:9040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789601575.140937:0:9040:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443262380240ns, next at 444262377568ns, rc = 0 00000004:00010000:2.0:1789601575.141813:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006813ab5 reply state 000000009d4553ee transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.141842:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.141853:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.141856:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789601575.141862:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601575.143356:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+70:12483:x1876532898403072:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 3244us (4348us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789601575.143382:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:3.0:1789601575.155772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.155907:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403200 00000100:00100000:0.0:1789601575.155917:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403200 00000100:00100000:0.0:1789601575.155979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:0.0:1789601575.155989:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+70:12483:x1876532898403200:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601575.156014:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601575.156047:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e46 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.156121:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.156146:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.156324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:0.0:1789601575.156328:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601575.156332:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467000, rc 0) 00000100:00100000:0.0:1789601575.156395:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+71:12483:x1876532898403200:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 407us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.156402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:3.0:1789601575.168957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.172667:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403328 00000100:00100000:2.0:1789601575.172682:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403328 00000100:00100000:2.0:1789601575.172762:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:2.0:1789601575.172773:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898403328:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789601575.173003:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+10:2416:x1876532898403328:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 232us (4058us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789601575.173011:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:3.0:1789601575.176676:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.176874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403584 00000100:00100000:0.0:1789601575.176888:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403584 00000100:00100000:0.0:1789601575.176961:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:0.0:1789601575.176971:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+71:12483:x1876532898403584:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601575.177601:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+72:12483:x1876532898403584:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 585us (893us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789601575.177610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789601575.179510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.179691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403840 00000100:00100000:0.0:1789601575.179701:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403840 00000100:00100000:0.0:1789601575.179768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:0.0:1789601575.179776:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+72:12483:x1876532898403840:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789601575.179876:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+72:12483:x1876532898403840:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 101us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.179900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:0.0:1789601575.181842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.181922:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898403968 00000100:00100000:2.0:1789601575.181933:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898403968 00000100:00100000:2.0:1789601575.181984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:2.0:1789601575.181991:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+72:12483:x1876532898403968:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.182012:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601575.182096:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2532 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e4d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182184:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182216:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182231:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601575.182290:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601575.182314:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182369:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030600/0x74872e3eca9f2532 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e4d expref: 74 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182390:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e4d expref: 73 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.182399:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.182402:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601575.182407:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0030000, rc 0) 00000100:00100000:2.0:1789601575.182722:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+73:12483:x1876532898403968:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 729us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.182731:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:3.0:1789601575.185362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.185458:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404096 00000100:00100000:2.0:1789601575.185481:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404096 00000100:00100000:2.0:1789601575.185551:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1789601575.185595:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+10:2415:x1876532898404096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.185619:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601575.185647:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e54 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601575.185678:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab2726, blocks: 0x0 00010000:00010000:2.0:1789601575.185703:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789601575.185720:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601575.185731:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.185778:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.185793:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737da00, rc 0) 00000100:00100000:2.0:1789601575.185854:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:2415:x1876532898404096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 262us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.185862:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1789601575.188828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.188934:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404352 00000100:00100000:0.0:1789601575.188947:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404352 00000100:00100000:0.0:1789601575.189105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:0.0:1789601575.189118:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+73:12483:x1876532898404352:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789601575.189307:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+73:12483:x1876532898404352:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.189317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:3.0:1789601575.191743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.192109:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404480 00000100:00100000:1.0:1789601575.192123:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404480 00000100:00100000:1.0:1789601575.192197:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:1.0:1789601575.192209:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+11:12483:x1876532898404480:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601575.192232:0:8857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601575.192256:0:8857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e5b expref: -99 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.192296:0:8857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.192306:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601575.192321:0:8857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601575.192327:0:8857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 12 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.192368:0:8857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.192384:0:8857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.192401:0:8857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918381696:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601575.192534:0:8857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601575.194878:0:8857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8857:1876532918381696:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601575.194924:0:8857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 12 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.194956:0:8857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ef000, rc 0) 00000100:00100000:1.0:1789601575.195120:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+12:12483:x1876532898404480:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2912us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.195131:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1789601575.196528:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.197529:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404608 00000100:00100000:1.0:1789601575.197543:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404608 00010000:00010000:1.0:1789601575.197763:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.197858:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:1.0:1789601575.197870:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+12:2415:x1876532898404608:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.197889:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.197919:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.197935:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.197963:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2540 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e54 expref: 12 pid: 8441 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.198004:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601575.198009:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601575.198028:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 11 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.198039:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 11 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.198086:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 11 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.198103:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876532918381824:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789601575.198322:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d435ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601575.205070:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876532918381824:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789601575.205162:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.205273:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+11:2415:x1876532898404608:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 7404us (8752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.205286:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:3.0:1789601575.205973:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.206421:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404736 00000100:00100000:0.0:1789601575.206431:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404736 00002000:00100000:0.0:1789601575.206991:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8df3c36a8e00 x1876532898404736/t0(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:171/0 lens 504/0 e 0 to 0 dl 1789601586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601575.207005:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36a8e00 with x1876532898404736 ext(0->12) 00002000:00010000:0.0:1789601575.207012:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c36a8e00 00000100:00100000:0.0:1789601575.207059:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789601575.207072:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+11:2416:x1876532898404736:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789601575.213321:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af09a131-8cce-462c-8c01-5d48daa688cf+13:2416:x1876532898404736:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 6242us (7340us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789601575.213335:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00002000:00100000:1.0:1789601575.213347:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8df3c36a8e00 x1876532898404736/t4294967321(0) o4->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:171/0 lens 504/448 e 0 to 0 dl 1789601586 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789601575.213379:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c36a8e00 with x1876532898404736 ext(0->12) 00002000:00010000:1.0:1789601575.213386:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c36a8e00 00000100:00100000:0.0:1789601575.221217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.221317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404864 00000100:00100000:3.0:1789601575.221332:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404864 00000100:00100000:3.0:1789601575.221410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 243 00000100:00100000:3.0:1789601575.221422:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+73:12483:x1876532898404864:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789601575.238253:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918381952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601575.238352:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601575.238618:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918381952 00000100:00100000:2.0:1789601575.238629:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918381952 00000001:00080000:0.0:1789601575.238733:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789601575.238744:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789601575.238778:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789601575.238797:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4f73a0000 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:2.0:1789601575.238813:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000020:00080000:0.0:1789601575.238817:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df3c3178300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4f73a03c0 00000020:00080000:0.0:1789601575.238822:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df3c3178000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c360a400 00000100:00100000:2.0:1789601575.238827:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918381952:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789601575.238851:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00002000:00000024:2.0:1789601575.238857:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 28672 free 3923525632 avail 3692003328 00000020:00080000:0.0:1789601575.238878:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df4f73a0f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789601575.238883:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df3c3178b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df4e14e6c00 00000020:00080000:0.0:1789601575.238886:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df3c3178400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c2a84e00 00000020:00080000:0.0:1789601575.238898:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1789601575.238927:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.238937:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918381952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (584us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601575.238944:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.238948:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:0.0:1789601575.238959:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.238968:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.238974:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.238983:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789601575.238986:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601575.239006:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df4f8af9900) 00010000:00010000:0.0:1789601575.239010:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.239016:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239023:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467e00/0x74872e3eca9f224c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239060:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239067:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239074:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239079:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.239083:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239088:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239096:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df4f8af9700) 00010000:00010000:0.0:1789601575.239099:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.239102:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239107:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f22f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239124:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239130:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239136:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239150:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.239153:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239160:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239169:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:0.0:1789601575.239172:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.239175:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239181:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2372 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239205:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239211:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239217:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239222:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.239225:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239231:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239248:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341cc00) 00010000:00010000:0.0:1789601575.239251:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.239253:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239259:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef600/0x74872e3eca9f2395 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239277:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239283:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239290:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239295:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.239298:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239303:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239311:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601575.239313:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601575.239316:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239323:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031800/0x74872e3eca9f2467 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239345:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239350:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239356:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239362:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601575.239365:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239370:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239377:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:0.0:1789601575.239380:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789601575.239383:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.239388:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030c00/0x74872e3eca9f2524 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601575.239532:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601575.239858:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1789601575.239886:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789601575.239960:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789601575.239974:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918382336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601575.239995:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918382464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789601575.240032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601575.240043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601575.240081:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918382336 00000100:00100000:2.0:1789601575.240088:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918382336 00000100:00100000:1.0:1789601575.240109:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918381952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601575.240133:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601575.240138:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789601575.240141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918382080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789601575.240151:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918382336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601575.240176:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789601575.240225:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918382336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.240232:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789601575.240268:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918382336:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789601575.240287:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601575.240548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918382208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789601575.240594:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601575.240664:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601575.240712:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918382464 00000100:00100000:1.0:1789601575.240716:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918382464 00000100:00100000:1.0:1789601575.240748:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918382208 00000100:00100000:1.0:1789601575.240751:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918382208 00000100:00100000:1.0:1789601575.240762:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918382080 00000100:00100000:1.0:1789601575.240764:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918382080 00000100:00100000:1.0:1789601575.240775:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789601575.240781:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1876532918382464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789601575.240803:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1789601575.240840:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab2725, atime: 0x6aab2725, ctime: 0x6aab2725, blocks: 0x8 00010000:00010000:1.0:1789601575.240849:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.240868:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789601575.240873:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601575.240881:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.240909:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.240921:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.240929:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.240947:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601575.241108:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601575.241119:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918382208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789601575.241296:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789601575.241300:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789601575 00002000:00010000:3.0:1789601575.241303:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789601575.241306:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789601574 -> 1789601575 00002000:00010000:3.0:1789601575.241309:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789601575.241363:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1876532918382208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (768us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789601575.241371:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601575.241389:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789601575.241396:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918382080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789601575.241425:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1789601575.241441:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.241461:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 12 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.241470:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3645:x1876532918382464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 679us (1418us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789601575.241488:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1789601575.241503:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789601575.241508:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601575.241513:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.241536:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601575.241547:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.241553:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 12 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.241622:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eec00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601575.241630:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.241636:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 12 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.241664:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601575.241670:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1876532918382592:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601575.241705:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.241729:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d6f8a4/0x74872e3eca9f254e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.241765:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601575.241769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601575.241772:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601575.241775:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8d80 going to sleep for 11 seconds 00000004:00080000:3.0:1789601575.241822:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df3c410c380/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789601575.241830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918382208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601575.241934:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:12483:x1876532898404864:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 20513us (20732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601575.241944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 243 00000004:00080000:1.0:1789601575.242076:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4f74c5f80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789601575.242086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918382464:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789601575.249100:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1789601575.249125:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789601575.249783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601575.249815:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.249906:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1876532918382592:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601575.249936:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.250009:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898404992 00000100:00100000:2.0:1789601575.250016:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898404992 00000100:00100000:2.0:1789601575.250073:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1789601575.250081:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+13:2416:x1876532898404992:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789601575.251861:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898405120 00000100:00100000:1.0:1789601575.251878:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898405120 00010000:00010000:1.0:1789601575.251929:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 14 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.251976:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:1.0:1789601575.251986:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+14:2416:x1876532898405120:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.252001:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.252008:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 14 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.252023:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 14 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.252051:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588283f2/0x74872e3eca9f2302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48db3 expref: 14 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.252088:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601575.252093:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601575.252100:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.252111:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.252155:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.252236:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+13:2416:x1876532898405120:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 251us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.252245:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 102 00010000:00010000:0.0:1789601575.254144:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.254178:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.254201:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.254209:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601575.254274:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601575.254336:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601575.254364:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.254377:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601575.254383:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.254396:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.254425:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.254434:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc3a31d1/0x74872e3eca9f2555 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.254466:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601575.254469:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601575.254472:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601575.254500:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1876532918382080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13098us (13829us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789601575.254511:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789601575.254610:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df3c410ca80/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789601575.254622:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918382080:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789601575.259080:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789601575.259095:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1789601575.259289:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898404992:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 9203us (9467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.259300:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:0.0:1789601575.269008:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.269107:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898405376 00000100:00100000:2.0:1789601575.269117:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898405376 00000100:00100000:2.0:1789601575.269177:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:2.0:1789601575.269198:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+21:12483:x1876532898405376:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.269251:0:9040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601575.269279:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0030000/0x74872e3eca9f2539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e4d expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.269304:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.269309:0:9040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601575.269339:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.269371:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.269381:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601575.269497:0:9040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ea6808b reply state 000000003f3711d5 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.269508:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.269528:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.269531:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601575.269542:0:9040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601575.269692:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+22:12483:x1876532898405376:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 505us (693us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789601575.269700:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:3.0:1789601575.280384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.280913:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898405504 00000100:00100000:2.0:1789601575.280924:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898405504 00000100:00100000:2.0:1789601575.280986:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1789601575.280997:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2415:x1876532898405504:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789601575.281143:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789601575.281147:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789601575 -> 1789601574 00002000:00010000:2.0:1789601575.281150:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789601573 00002000:00010000:2.0:1789601575.281153:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789601575 -> 1789601574 00002000:00010000:2.0:1789601575.281156:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789601575.281223:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2415:x1876532898405504:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 228us (848us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789601575.281245:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:3.0:1789601575.290302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.290425:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898405760 00000100:00100000:2.0:1789601575.290442:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898405760 00000100:00100000:2.0:1789601575.290525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 245 00000100:00100000:2.0:1789601575.290536:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:12483:x1876532898405760:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.290649:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.290667:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.290678:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.290713:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.290728:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.290742:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918382720:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601575.290831:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fec6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601575.295387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.295521:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876532918382720:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601575.295550:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.295657:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898405888 00000100:00100000:1.0:1789601575.295672:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898405888 00010000:00010000:1.0:1789601575.295739:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 23 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.295790:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:1.0:1789601575.295801:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+23:2415:x1876532898405888:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.295821:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.295830:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 23 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295868:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 23 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295896:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3466e00/0x74872e3eca9f251d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e3f expref: 23 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295927:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:1.0:1789601575.295932:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295944:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295952:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.295986:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601575.296028:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296053:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.296077:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:2415:x1876532898405888:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 275us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.296087:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00010000:00010000:2.0:1789601575.296113:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296124:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296479:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296485:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.296490:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296498:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296525:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.296528:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789601575.296533:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.296541:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d600/0x74872e3eca9f2563 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.296656:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+21:12483:x1876532898405760:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 6118us (6364us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789601575.296666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 245 00000100:00100000:0.0:1789601575.301920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.305391:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406016 00000100:00100000:3.0:1789601575.305408:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406016 00000100:00100000:3.0:1789601575.305485:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789601575.305497:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898406016:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789601575.305554:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.305641:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.305650:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601575.305655:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601575.305660:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.305700:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 8 pid: 8857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.305715:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 8 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601575.305731:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1876532918382848:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601575.305815:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601575.313499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.313598:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406144 00000100:00100000:1.0:1789601575.313612:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406144 00010000:00010000:1.0:1789601575.313660:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 9 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.313722:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:1.0:1789601575.313733:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898406144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.313771:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.313802:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 9 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.313819:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 9 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.313851:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601575.313856:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601575.313863:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.313875:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.313905:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.313969:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+9:2416:x1876532898406144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 237us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.313977:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00010000:00010000:3.0:1789601575.315658:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2547 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e5b expref: 8 pid: 8857 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601575.315686:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1876532918382848:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601575.315717:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315731:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315756:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315793:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315803:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315814:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315821:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601575.315827:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315838:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315861:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601575.315870:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb1ed7c/0x74872e3eca9f256a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601575.315996:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898406016:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 10500us (14084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601575.316007:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1789601575.322524:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.322795:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406400 00000100:00100000:2.0:1789601575.322809:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406400 00000100:00100000:2.0:1789601575.323087:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:2.0:1789601575.323100:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+21:12483:x1876532898406400:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789601575.323237:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.323259:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.323271:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.323327:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.323344:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 21 pid: 6523 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.323362:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918382976:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601575.323486:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fec6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601575.325854:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918382976:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601575.326824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.327328:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406528 00000100:00100000:1.0:1789601575.327339:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406528 00010000:00010000:1.0:1789601575.327394:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 22 pid: 6523 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.327453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:1.0:1789601575.327465:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+22:2416:x1876532898406528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.327504:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.327512:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 22 pid: 6523 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.327528:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 22 pid: 6523 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.327593:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031c00/0x74872e3eca9f2460 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e07 expref: 22 pid: 6523 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.327606:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.327616:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601575.328553:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 21 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.328632:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.328641:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.328649:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.328801:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.328888:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af09a131-8cce-462c-8c01-5d48daa688cf+21:2416:x1876532898406528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1423us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.328909:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00010000:00010000:2.0:1789601575.329058:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329068:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329783:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329801:0:9040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329810:0:9040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329852:0:9040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.329868:0:9040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 21 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.329886:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918383104:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601575.331050:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601575.337453:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918383104:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601575.337496:0:9040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601575.339479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.340254:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406656 00000100:00100000:1.0:1789601575.340267:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406656 00010000:00010000:1.0:1789601575.340333:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.340421:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:1.0:1789601575.340432:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+22:2416:x1876532898406656:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.340450:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.340458:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340475:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340502:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467000/0x74872e3eca9f252b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e46 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340521:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:1.0:1789601575.340527:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340539:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340548:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.340615:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.340678:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af09a131-8cce-462c-8c01-5d48daa688cf+21:2416:x1876532898406656:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 247us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.340685:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 106 00010000:00010000:2.0:1789601575.340777:0:9040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.340787:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601575.340940:0:9040:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789601575.341767:0:9040:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789601575.341816:0:9040:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789601575.342001:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9040:1876532918383232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789601575.344509:0:9040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601575.344598:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c42f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601575.344776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918383232 00000100:00100000:1.0:1789601575.344793:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918383232 00000100:00100000:1.0:1789601575.344874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789601575.344887:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9040:x1876532918383232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789601575.345079:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9040:x1876532918383232:12345-0@lo:1000:mdt00_003.0 Request processed in 194us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.345087:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789601575.345133:0:9040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789601575.345142:0:9040:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1789601575.345199:0:9040:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df3c410c380, transno 4294967322 00000100:00100000:3.0:1789601575.345214:0:9040:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8df3c410ca80 x1876532918382080/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789601591 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601575.345230:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9040:1876532918383232:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789601575.345432:0:9040:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1789601575.345510:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9040:1876532918383360:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789601575.345578:0:9040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601575.345615:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601575.345682:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918383360 00000100:00100000:0.0:1789601575.345689:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918383360 00000100:00100000:0.0:1789601575.345745:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789601575.345755:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9040:x1876532918383360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789601575.345995:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9040:x1876532918383360:12345-0@lo:1000:mdt00_003.0 Request processed in 242us (417us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789601575.346004:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789601575.346071:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9040:1876532918383360:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789601575.346116:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346126:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346136:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346142:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.346147:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346157:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346177:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601575.346180:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601575.346197:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346205:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2578 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346231:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346239:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346245:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346257:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.346261:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346268:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346277:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601575.346279:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601575.346288:0:9040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346301:0:9040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346313:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.346344:0:9040:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 24 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.346356:0:9040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918383488:192.168.203.48@tcp:105: 00000100:00100000:2.0:1789601575.346482:0:9040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df5020d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601575.348849:0:9040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9040:1876532918383488:192.168.203.48@tcp:105: 00010000:00010000:2.0:1789601575.348890:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.348920:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f24bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.348962:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.348981:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.348995:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349007:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349014:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349021:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349026:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737de00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.349030:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349038:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349049:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601575.349053:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601575.349057:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349069:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f257f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349080:0:9040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349087:0:9040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349093:0:9040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349098:0:9040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737ca00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.349100:0:9040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349106:0:9040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349113:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601575.349115:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789601575.349118:0:9040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.349124:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f2571 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.349350:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+24:12483:x1876532898406400:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 26252us (26840us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789601575.349364:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 246 00000020:00080000:2.0:1789601575.349379:0:9040:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789601575.349484:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601575.349491:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789601575.349639:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000040:00080000:1.0:1789601575.350072:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:2.0:1789601575.350077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898406784 00000040:00080000:1.0:1789601575.350083:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601575.350087:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898406784 00000100:00100000:2.0:1789601575.350142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:2.0:1789601575.350154:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:12482:x1876532898406784:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:2.0:1789601575.350284:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:12482:x1876532898406784:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 133us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.350297:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1789601575.354529:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601575.354685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.354697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407040 00000100:00100000:2.0:1789601575.354709:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407040 00000100:00100000:2.0:1789601575.354900:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:2.0:1789601575.354914:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0980050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+24:12483:x1876532898407040:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789601575.355297:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789601575.355343:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789601575.355391:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355413:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355439:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355449:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355457:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355463:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.355505:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789601575.355650:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0980050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+26:12483:x1876532898407040:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 737us (1135us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789601575.355659:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000020:00080000:2.0:1789601575.355666:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789601575.356738:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601575.356752:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.356762:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601575.356767:0:7464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.356778:0:7464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.356796:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:1.0:1789601575.356800:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601575.356805:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.356811:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f2586 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.356829:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601575.356844:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601575.356846:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601575.357089:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407296 00000100:00100000:0.0:1789601575.357100:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407296 00000100:00100000:0.0:1789601575.357168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:0.0:1789601575.357180:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+26:12482:x1876532898407296:12345-192.168.203.48@tcp:58:lfs.0 00000040:00080000:0.0:1789601575.357407:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789601575.357501:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+26:12482:x1876532898407296:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 323us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601575.357510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:0.0:1789601575.377690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.378009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407424 00000100:00100000:2.0:1789601575.378022:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407424 00000100:00100000:2.0:1789601575.378135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:2.0:1789601575.378148:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+26:12485:x1876532898407424:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601575.378236:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601575.378292:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f258d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e62 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378399:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378416:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378429:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378445:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378468:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378476:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378619:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378631:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378640:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378680:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.378696:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 27 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601575.378947:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918383616:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601575.379103:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601575.381971:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601575.382066:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876532918383616:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601575.382099:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.382158:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407680 00000100:00100000:1.0:1789601575.382168:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407680 00000100:00100000:1.0:1789601575.387415:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:1.0:1789601575.387442:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+28:6187:x1876532898407680:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789601575.387768:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:6187:x1876532898407680:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 338us (5808us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789601575.387776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789601575.403743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601575.405043:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407808 00000100:00100000:1.0:1789601575.405058:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407808 00010000:00010000:1.0:1789601575.405152:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 29 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601575.405209:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:1.0:1789601575.405220:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f363b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+29:2416:x1876532898407808:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601575.405237:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601575.405245:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 29 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405258:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 29 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405280:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1c00/0x74872e3eca9f24ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e23 expref: 29 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405297:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601575.405320:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405330:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405338:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601575.405371:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601575.405435:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f363b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af09a131-8cce-462c-8c01-5d48daa688cf+28:2416:x1876532898407808:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 216us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601575.405442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00010000:00010000:2.0:1789601575.405536:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405546:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601575.405619:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789601575.405630:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601575.405653:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405676:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405683:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405689:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405695:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737de00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.405699:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405706:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405716:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:2.0:1789601575.405719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601575.405723:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2594 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405741:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405757:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405763:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405768:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601575.405771:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405791:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df3c341ce00) 00010000:00010000:2.0:1789601575.405802:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601575.405805:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405810:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f259b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f258d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e62 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405861:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e62 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601575.405868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601575.405870:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601575.405879:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ce00, rc 0) 00000100:00100000:2.0:1789601575.405910:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+27:12485:x1876532898407424:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 27766us (28234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601575.405917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 248 00010000:00010000:1.0:1789601575.564540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601576.262354:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601576.262380:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918383744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601576.262450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601576.262740:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918383744 00000100:00100000:0.0:1789601576.262748:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918383744 00000100:00100000:0.0:1789601576.262838:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789601576.262848:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918383744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601576.262884:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601576.262942:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918383744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601576.262949:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789601576.263027:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918383744:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789601576.406539:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601576.406552:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601576.406634:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789601576.406646:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601576.406841:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918383872:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601576.407675:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601576.428066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601576.428275:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1876532918383872:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601576.429396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898407936 00000100:00100000:3.0:1789601576.429409:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898407936 00000100:00100000:3.0:1789601576.429523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:3.0:1789601576.429536:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+27:12496:x1876532898407936:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601576.429599:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601576.429759:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+27:12496:x1876532898407936:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 224us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601576.429767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:1.0:1789601576.440284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601576.440596:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898408192 00000100:00100000:3.0:1789601576.440610:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898408192 00000100:00100000:3.0:1789601576.440999:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:3.0:1789601576.441027:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+27:12496:x1876532898408192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601576.441051:0:9040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601576.441091:0:9040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f25a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e69 expref: -99 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.441214:0:9040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f25b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.441235:0:9040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f25b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.441249:0:9040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f25b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601576.441283:0:9040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789601576.441392:0:9040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678c00/0x74872e3eca9f25a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e69 expref: 30 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.441412:0:9040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f25b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e69 expref: 29 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.441420:0:9040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601576.441423:0:9040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601576.441427:0:9040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678600, rc 0) 00000100:00100000:3.0:1789601576.445799:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af09a131-8cce-462c-8c01-5d48daa688cf+29:12496:x1876532898408192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 4769us (5514us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789601576.445814:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:1.0:1789601576.459319:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601576.459394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898408320 00000100:00100000:0.0:1789601576.459414:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898408320 00000100:00100000:0.0:1789601576.459523:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789601576.459536:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:2416:x1876532898408320:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601576.459588:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601576.459625:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678600/0x74872e3eca9f25b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e69 expref: 29 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601576.459652:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:0.0:1789601576.459658:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601576.459872:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af09a131-8cce-462c-8c01-5d48daa688cf+28:2416:x1876532898408320:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 333us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601576.459887:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789601576.467451:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601576.467547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898408576 00000100:00100000:3.0:1789601576.467580:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898408576 00000100:00100000:3.0:1789601576.467651:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:3.0:1789601576.467671:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+28:12496:x1876532898408576:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789601576.467758:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.467778:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.467811:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.467996:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468005:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468013:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468019:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601576.468024:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468032:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468044:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601576.468047:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601576.468052:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.468059:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679c00/0x74872e3eca9f25be lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601576.468173:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+29:12496:x1876532898408576:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 511us (744us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789601576.468194:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 251 00000040:00080000:1.0:1789601576.468648:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601576.468657:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601576.469910:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789601576.469930:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601576.482033:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601576.482079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898408832 00000100:00100000:3.0:1789601576.482089:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898408832 00000100:00100000:3.0:1789601576.482140:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1789601576.482151:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+29:12496:x1876532898408832:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789601576.482405:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+30:12496:x1876532898408832:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 256us (382us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789601576.482420:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:3.0:1789601576.581869:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601576.686165:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601576.686186:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601576.686223:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789601576.686229:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601576.774965:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601576.774995:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d015b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918384000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601576.775070:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601576.775190:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384000 00000100:00100000:0.0:1789601576.775197:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384000 00000100:00100000:0.0:1789601576.775253:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789601576.775263:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918384000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601576.775298:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789601576.775347:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918384000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601576.775354:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789601576.775447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d015b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918384000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601576.951843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601576.951993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409088 00000100:00100000:3.0:1789601576.952003:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409088 00000100:00100000:3.0:1789601576.952071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:3.0:1789601576.952081:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+30:12509:x1876532898409088:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601576.952104:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601576.952125:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f25c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e70 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.952243:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f25cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.952259:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f25cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.952272:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f25cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601576.952297:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789601576.953756:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1678400/0x74872e3eca9f25c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e70 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.953783:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f25cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e70 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601576.953791:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:3.0:1789601576.953794:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789601576.953798:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679600, rc 0) 00000100:00100000:3.0:1789601576.953863:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+32:12509:x1876532898409088:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1784us (2029us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789601576.953872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:2.0:1789601576.972790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601576.972826:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409216 00000100:00100000:2.0:1789601576.972836:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409216 00000100:00100000:2.0:1789601576.972902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:2.0:1789601576.972912:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+32:12509:x1876532898409216:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789601576.973232:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973250:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973262:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973300:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973308:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973315:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973334:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737de00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601576.973338:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973346:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973364:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:2.0:1789601576.973368:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601576.973373:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601576.973380:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f25da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601576.973453:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+32:12509:x1876532898409216:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 541us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601576.973461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:3.0:1789601577.136712:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601577.136847:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409344 00000100:00100000:2.0:1789601577.136858:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409344 00000100:00100000:2.0:1789601577.136936:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:2.0:1789601577.136946:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898409344:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789601577.136964:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601577.136987:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f25e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e77 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601577.137010:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aab2726, atime: 0x6aab2725, ctime: 0x6aab2726, blocks: 0x8 00010000:00010000:2.0:1789601577.137031:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789601577.137049:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601577.137058:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f25e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e77 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601577.137078:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f25e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e77 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601577.137092:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737de00, rc 0) 00000100:00100000:2.0:1789601577.137160:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2416:x1876532898409344:12345-192.168.203.48@tcp:101:cat.0 Request processed in 214us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601577.137167:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00080000:0.0:1789601577.137405:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601577.141803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601577.143818:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409472 00000100:00100000:3.0:1789601577.143833:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409472 00002000:00100000:3.0:1789601577.144016:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8df3c3426300 x1876532898409472/t0(0) o3->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:173/0 lens 488/0 e 0 to 0 dl 1789601588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601577.144027:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3426300 with x1876532898409472 ext(0->4095) 00002000:00010000:3.0:1789601577.144033:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c3426300 00000100:00100000:3.0:1789601577.144085:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1789601577.144095:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898409472:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:3.0:1789601577.144296:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898409472:12345-192.168.203.48@tcp:3:cat.0 Request processed in 202us (2501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789601577.144304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00002000:00100000:3.0:1789601577.144328:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8df3c3426300 x1876532898409472/t0(0) o3->af09a131-8cce-462c-8c01-5d48daa688cf@192.168.203.48@tcp:173/0 lens 488/4536 e 0 to 0 dl 1789601588 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601577.144337:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df3c3426300 with x1876532898409472 ext(0->4095) 00002000:00010000:3.0:1789601577.144341:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df3c3426300 00010000:00010000:1.0:1789601577.612541:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601578.310058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918384256:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.310127:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601578.310199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918384768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.310242:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601578.310281:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918385280:0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.310299:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384256 00000100:00100000:1.0:1789601578.310308:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601578.310315:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384256 00000100:00100000:1.0:1789601578.310369:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789601578.310379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918384384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.310387:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384768 00000100:00100000:3.0:1789601578.310392:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384768 00000100:00100000:3.0:1789601578.310423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385280 00000100:00100000:1.0:1789601578.310430:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601578.310431:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385280 00000100:00100000:1.0:1789601578.310469:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918384896:0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.310470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789601578.310486:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918384256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.310500:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601578.310515:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918385408:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.310611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918384128:0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.310691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918384512:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.311848:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601578.311902:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918384256:12345-0@lo:400:kworker.0 Request processed in 1414us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601578.311913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918384256:0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.311919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789601578.311963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384896 00000100:00100000:3.0:1789601578.311970:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384896 00000100:00100000:1.0:1789601578.311982:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385408 00000100:00100000:1.0:1789601578.311991:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385408 00000100:00100000:3.0:1789601578.312010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789601578.312021:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918384768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.312043:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789601578.312055:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918385280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.312086:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918384768:12345-0@lo:400:kworker.0 Request processed in 67us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601578.312095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789601578.312126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789601578.312128:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918385280:12345-0@lo:400:kworker.0 Request processed in 70us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601578.312153:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918384896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.312153:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789601578.312195:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789601578.312203:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918385408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.312232:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918385408:12345-0@lo:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601578.312239:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789601578.312265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384384 00000100:00100000:1.0:1789601578.312269:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384384 00000100:00100000:1.0:1789601578.312314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789601578.312320:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918384384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.312353:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918384384:12345-0@lo:400:kworker.0 Request processed in 33us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601578.312359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789601578.312384:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918384384:0@lo:400:kworker.0 00010000:00080000:1.0:1789601578.312396:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4c12af100 x1876532918385408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601578.312475:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918384896:12345-0@lo:400:kworker.0 Request processed in 336us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601578.312482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789601578.313184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918385408:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.313211:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918384768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.313222:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918385280:0@lo:400:kworker.0 00010000:00080000:1.0:1789601578.313250:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f74c5180 x1876532918384896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601578.313261:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918384896:0@lo:400:kworker.0 00000100:00080000:1.0:1789601578.313307:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601578.313312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601578.318323:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601578.318386:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918384640:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.318441:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601578.318463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918385152:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.318487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601578.318505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918385664:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.318544:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601578.318606:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384640 00000100:00100000:2.0:1789601578.318613:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384640 00000100:00100000:2.0:1789601578.318655:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789601578.318664:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918384640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.318916:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918384640:12345-0@lo:400:kworker.0 Request processed in 252us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601578.318937:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789601578.318963:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385152 00000100:00100000:2.0:1789601578.318967:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385152 00000100:00100000:2.0:1789601578.319000:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385664 00000100:00100000:2.0:1789601578.319003:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385664 00000100:00100000:2.0:1789601578.319022:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601578.319028:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918385152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.319059:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918385152:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601578.319065:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601578.319077:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601578.319083:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918385664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.319108:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918385664:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601578.319114:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1789601578.319148:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601578.319151:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601578.319190:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918384640:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.319200:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789601578.319205:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1789601578.319225:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4c12aed80, transno 4294967308 00000004:00080000:2.0:1789601578.319235:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789601578.319246:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4f74c5f80, transno 4294967311 00000100:00100000:2.0:1789601578.319250:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918385152:0@lo:400:kworker.0 00000100:00100000:2.0:1789601578.319262:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918385664:0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.320894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384128 00000100:00100000:3.0:1789601578.320907:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384128 00000100:00100000:3.0:1789601578.320961:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789601578.320970:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601578.321037:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3648:x1876532918384128:12345-0@lo:400:kworker.0 Request processed in 69us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601578.321043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789601578.321139:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918384128:0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601578.323268:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918385024:0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601578.323329:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918385536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323349:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601578.323392:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385024 00000100:00100000:0.0:1789601578.323410:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385024 00000100:00100000:0.0:1789601578.323459:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385536 00000100:00100000:0.0:1789601578.323463:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385536 00000100:00100000:0.0:1789601578.323485:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789601578.323494:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918385024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323596:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918385024:12345-0@lo:400:kworker.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601578.323603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789601578.323619:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789601578.323624:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918385536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323650:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918385536:12345-0@lo:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601578.323655:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1789601578.323673:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601578.323841:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601578.323874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918385024:0@lo:400:kworker.0 00000100:00100000:0.0:1789601578.323886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918385536:0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.324118:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918384512 00000100:00100000:1.0:1789601578.324123:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918384512 00000100:00100000:1.0:1789601578.324160:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789601578.324176:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918384512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601578.324219:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918384512:12345-0@lo:400:kworker.0 Request processed in 44us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601578.324225:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789601578.324325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918384512:0@lo:400:kworker.0 00010000:00010000:1.0:1789601578.629775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601578.828830:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918385792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601578.828893:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601578.828957:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385792 00000100:00100000:2.0:1789601578.828964:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385792 00000100:00100000:2.0:1789601578.829002:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601578.829008:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918385792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601578.829034:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601578.829072:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918385792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601578.829079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601578.829118:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918385792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601578.829338:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601578.829347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918385920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601578.829377:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601578.829405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918385920 00000100:00100000:3.0:1789601578.829409:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918385920 00000100:00100000:3.0:1789601578.829432:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789601578.829438:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918385920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789601578.829449:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789601578.829478:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918385920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601578.829483:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789601578.829513:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918385920:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789601579.653676:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601579.825364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.825409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.825440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.825462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.825499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.825521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601579.825914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409600 00000100:00100000:3.0:1789601579.825928:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409600 00000100:00100000:3.0:1789601579.825992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 396 00000100:00100000:3.0:1789601579.826004:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898409600:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601579.826102:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2417:x1876532898409600:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 92us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601579.826125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 396 00000100:00100000:3.0:1789601579.826217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409856 00000100:00100000:3.0:1789601579.826222:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409856 00000100:00100000:3.0:1789601579.826256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410368 00000100:00100000:3.0:1789601579.826259:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410368 00000100:00100000:3.0:1789601579.826271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409728 00000100:00100000:3.0:1789601579.826273:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409728 00000100:00100000:3.0:1789601579.826299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 353 00000100:00100000:3.0:1789601579.826307:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898409856:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601579.826339:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898409856:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 33us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601579.826346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 353 00000100:00100000:3.0:1789601579.826358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 354 00000100:00100000:3.0:1789601579.826364:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898410368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601579.826385:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898410368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 21us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601579.826391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 354 00000100:00100000:3.0:1789601579.826401:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 355 00000100:00100000:3.0:1789601579.826407:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+32:2417:x1876532898409728:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601579.826429:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+32:2417:x1876532898409728:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601579.826435:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 355 00000100:00100000:1.0:1789601579.826963:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601579.826995:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410240 00000100:00100000:1.0:1789601579.827001:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410240 00000100:00100000:1.0:1789601579.827035:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 356 00000100:00100000:1.0:1789601579.827043:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898410240:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601579.827074:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2417:x1876532898410240:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601579.827081:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 356 00000100:00100000:0.0:1789601579.827298:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410112 00000100:00100000:0.0:1789601579.827304:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410112 00000100:00100000:0.0:1789601579.827349:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898409984 00000100:00100000:0.0:1789601579.827353:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898409984 00000100:00100000:0.0:1789601579.827379:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:0.0:1789601579.827386:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898410112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601579.827417:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+8:2417:x1876532898410112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601579.827423:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:0.0:1789601579.827436:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:0.0:1789601579.827442:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898409984:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601579.827494:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2417:x1876532898409984:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 51us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601579.827500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00080000:0.0:1789601579.827522:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601579.827526:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601579.827529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601579.827531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789601580.358236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601580.358263:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918386048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601580.358340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601580.358427:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386048 00000100:00100000:1.0:1789601580.358437:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386048 00000100:00100000:1.0:1789601580.358488:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789601580.358498:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918386048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601580.358532:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789601580.358835:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918386048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 337us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601580.358844:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1789601580.358870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601580.358913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918386176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601580.358955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601580.358994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918386048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601580.359017:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386176 00000100:00100000:1.0:1789601580.359021:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386176 00000100:00100000:1.0:1789601580.359055:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789601580.359062:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918386176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601580.359073:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789601580.359107:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918386176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601580.359114:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1789601580.359129:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601580.359158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918386176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601580.677725:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789601580.876674:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789601580.876703:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df3c34b8000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789601580.876708:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7204500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c34b8d80 00000020:00080000:1.0:1789601580.876711:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df4f7204900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df3c360b200 00000020:00080000:1.0:1789601580.876734:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1789601580.876892:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876905:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876913:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876919:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601580.876924:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876931:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876948:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df4c2e8b500) 00010000:00010000:2.0:1789601580.876967:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601580.876972:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601580.876991:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d400/0x74872e3eca9f255c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9040 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789601580.877311:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789601580.877380:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789601580.877634:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1789601580.877648:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:2.0:1789601581.388207:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601581.388239:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918386304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601581.388320:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601581.388745:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386304 00000100:00100000:1.0:1789601581.388754:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386304 00000100:00100000:1.0:1789601581.388811:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789601581.388820:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918386304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601581.388854:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789601581.388919:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918386304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601581.388944:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789601581.389031:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918386304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601581.703952:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601581.893934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601581.893958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918386432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601581.894026:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601581.894106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386432 00000100:00100000:3.0:1789601581.894113:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386432 00000100:00100000:3.0:1789601581.894176:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789601581.894186:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918386432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601581.894219:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789601581.894264:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918386432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601581.894271:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789601581.894318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918386432:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789601582.087620:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789601582.597733:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601582.597743:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601582.597763:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789601582.597771:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789601582.728673:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601582.948336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601582.948433:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410496 00000100:00100000:3.0:1789601582.948449:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410496 00000100:00100000:3.0:1789601582.948595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:3.0:1789601582.948609:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:12170:x1876532898410496:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789601582.948862:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af09a131-8cce-462c-8c01-5d48daa688cf+18:12170:x1876532898410496:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 256us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601582.948870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00080000:1.0:1789601582.949449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601582.951454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601582.954909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410624 00000100:00100000:1.0:1789601582.954930:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410624 00000100:00100000:2.0:1789601582.955347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00100000:2.0:1789601582.955365:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:12170:x1876532898410624:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789601582.955479:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:12170:x1876532898410624:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 119us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601582.955486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00080000:1.0:1789601582.958505:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601582.965496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601582.965631:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898410880 00000100:00100000:0.0:1789601582.965652:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898410880 00000100:00100000:0.0:1789601582.965721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:0.0:1789601582.965732:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+18:12170:x1876532898410880:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601582.965954:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:12170:x1876532898410880:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 222us (465us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789601582.965960:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:0.0:1789601583.434953:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918386816:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.435054:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601583.435139:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918386560:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.435318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918386688:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.435357:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601583.435425:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386816 00000100:00100000:1.0:1789601583.435435:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386816 00000100:00100000:1.0:1789601583.435499:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789601583.435510:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918386816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.435636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601583.435704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386560 00000100:00100000:2.0:1789601583.435711:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386560 00000100:00100000:2.0:1789601583.435755:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789601583.435763:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918386560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.435812:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918386560:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601583.435818:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789601583.436035:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918386560:0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.436079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386688 00000100:00100000:2.0:1789601583.436097:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386688 00000100:00100000:2.0:1789601583.436141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789601583.436259:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918386688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.436385:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918386688:12345-0@lo:400:kworker.0 Request processed in 237us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601583.436454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789601583.437827:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918386688:0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.440789:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918386944:0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.440976:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601583.441057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918386944 00000100:00100000:3.0:1789601583.441068:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918386944 00000100:00100000:3.0:1789601583.441139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789601583.441151:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918386944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.441216:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918386944:12345-0@lo:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601583.441224:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789601583.441278:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918386944:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.448074:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918386816:12345-0@lo:400:kworker.0 Request processed in 12553us (13006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601583.448093:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789601583.451096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918386816:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.451152:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918387328:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.451222:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.451273:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601583.451279:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918387456:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.451310:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.451352:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387456 00000100:00100000:0.0:1789601583.451361:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387456 00000100:00100000:0.0:1789601583.451428:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601583.451438:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918387456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.451490:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918387456:12345-0@lo:400:kworker.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601583.451497:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1789601583.451523:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601583.451541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918387456:0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.452337:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387328 00000100:00100000:2.0:1789601583.452342:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387328 00000100:00100000:2.0:1789601583.452383:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789601583.452394:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918387328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.452439:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918387328:12345-0@lo:400:kworker.0 Request processed in 49us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601583.452445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789601583.452510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918387968:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.452542:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.453198:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601583.453208:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918387840:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.453242:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601583.453315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918387072:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.453352:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.460293:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387968 00000100:00100000:0.0:1789601583.460311:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387968 00000100:00100000:0.0:1789601583.460386:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601583.460399:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.460498:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918387968:12345-0@lo:400:kworker.0 Request processed in 103us (7955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601583.460506:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789601583.460579:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918387968:0@lo:400:kworker.0 00000100:00080000:0.0:1789601583.463163:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601583.463190:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601583.463213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918387200:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.463246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918387584:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.463279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.463279:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601583.463300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918388096:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.463301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918387712:0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.463319:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.463319:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601583.463357:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387584 00000100:00100000:0.0:1789601583.463366:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387584 00000100:00100000:1.0:1789601583.463368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387840 00000100:00100000:1.0:1789601583.463371:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387840 00000100:00100000:0.0:1789601583.463422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388096 00000100:00100000:0.0:1789601583.463425:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388096 00000100:00100000:2.0:1789601583.463457:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789601583.463470:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.463530:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918387584:12345-0@lo:400:kworker.0 Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601583.463539:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789601583.463614:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918387584:0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.463652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387200 00000100:00100000:2.0:1789601583.463657:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387200 00000100:00100000:3.0:1789601583.464043:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387072 00000100:00100000:3.0:1789601583.464049:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387072 00000100:00100000:3.0:1789601583.464081:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789601583.464089:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918387072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.464149:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918387072:12345-0@lo:400:kworker.0 Request processed in 61us (10796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601583.464155:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789601583.464190:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918387072:0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.464232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918387712 00000100:00100000:3.0:1789601583.464236:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918387712 00000100:00100000:1.0:1789601583.467534:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789601583.467550:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918387840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601583.468195:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876532918387840:12345-0@lo:400:kworker.0 Request processed in 648us (14950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601583.468223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00080000:1.0:1789601583.468301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3427480 x1876532918387328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601583.468319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918387328:0@lo:400:kworker.0 00000100:00080000:1.0:1789601583.468377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601583.468385:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601583.468389:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601583.468392:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601583.468522:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36a9c00 x1876532918387840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601583.468533:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918387840:0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.470378:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789601583.470396:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918387200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601583.470513:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918387200:12345-0@lo:400:kworker.0 Request processed in 123us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601583.470522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789601583.470695:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601583.470705:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918388096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.470754:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918388096:12345-0@lo:400:kworker.0 Request processed in 51us (7434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601583.470761:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601583.470807:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918387200:0@lo:400:kworker.0 00000100:00100000:0.0:1789601583.470850:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789601583.470856:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df3c410ca80, transno 4294967323 00000004:00080000:0.0:1789601583.471203:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789601583.471223:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918388096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.472438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789601583.472453:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918387712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601583.472542:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876532918387712:12345-0@lo:400:kworker.0 Request processed in 94us (9222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601583.472549:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789601583.472712:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876532918387712:0@lo:400:kworker.0 00010000:00010000:1.0:1789601583.749795:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601583.942431:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601583.942550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601583.942730:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388224 00000100:00100000:1.0:1789601583.942741:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388224 00000100:00100000:1.0:1789601583.942810:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789601583.942823:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918388224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601583.942869:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601583.942932:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918388224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601583.942940:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601583.943160:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601583.944369:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601583.944389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918388352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601583.944447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601583.944587:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388352 00000100:00100000:1.0:1789601583.944595:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388352 00000100:00100000:1.0:1789601583.944642:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789601583.944651:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918388352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601583.944671:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601583.944743:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918388352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601583.944751:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789601583.946236:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918388352:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789601584.773795:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601584.928954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929001:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929044:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929107:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929146:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601584.929220:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411520 00000100:00100000:0.0:1789601584.929233:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411520 00000100:00100000:0.0:1789601584.929302:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411392 00000100:00100000:0.0:1789601584.929306:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411392 00000100:00100000:0.0:1789601584.929334:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601584.929346:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898411520:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601584.929454:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+7:2416:x1876532898411520:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 109us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601584.929462:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601584.929482:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:0.0:1789601584.929489:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898411392:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601584.929514:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898411392:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601584.929521:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:0.0:1789601584.929541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411264 00000100:00100000:0.0:1789601584.929545:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411264 00000100:00100000:0.0:1789601584.929596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411776 00000100:00100000:0.0:1789601584.929600:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411776 00000100:00100000:0.0:1789601584.929613:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411136 00000100:00100000:0.0:1789601584.929615:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411136 00000100:00100000:0.0:1789601584.929630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411648 00000100:00100000:0.0:1789601584.929633:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411648 00000100:00100000:0.0:1789601584.929649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 363 00000100:00100000:1.0:1789601584.929837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 364 00000100:00100000:1.0:1789601584.929848:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898411776:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601584.929884:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898411776:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601584.929891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 364 00000100:00100000:1.0:1789601584.929907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 365 00000100:00100000:1.0:1789601584.929913:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:2416:x1876532898411136:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601584.929946:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:2416:x1876532898411136:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 33us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601584.929952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 365 00000100:00100000:1.0:1789601584.929965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 366 00000100:00100000:1.0:1789601584.929971:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898411648:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601584.929995:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2416:x1876532898411648:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601584.930001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 366 00000100:00080000:1.0:1789601584.930039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601584.930044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601584.930047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601584.930049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601584.930300:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898411264:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601584.930349:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d015bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2416:x1876532898411264:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 693us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601584.930365:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 363 00000100:00100000:3.0:1789601584.930681:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411008 00000100:00100000:3.0:1789601584.930689:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411008 00000100:00100000:3.0:1789601584.930726:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 398 00000100:00100000:3.0:1789601584.930734:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898411008:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601584.930777:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2416:x1876532898411008:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 44us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601584.930783:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 398 00000001:02000400:0.0:1789601585.095440:0:14858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:33:03 (1789601583) 00000100:00100000:0.0:1789601585.477799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918388480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601585.477885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601585.478005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918388608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601585.478039:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601585.478086:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388480 00000100:00100000:2.0:1789601585.478095:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388480 00000100:00100000:2.0:1789601585.478156:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388608 00000100:00100000:2.0:1789601585.478160:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388608 00000100:00100000:2.0:1789601585.478179:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601585.478188:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918388480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601585.478225:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1789601585.478590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601585.485450:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918388480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7247us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601585.485470:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601585.485533:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601585.485550:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918388608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601585.485601:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789601585.485690:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918388608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (7650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601585.485697:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601585.485768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918388608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601585.486702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918388480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789601585.798172:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601586.506667:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601586.506704:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918388736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601586.506795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601586.506992:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388736 00000100:00100000:0.0:1789601586.507003:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388736 00000100:00100000:0.0:1789601586.507066:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789601586.507077:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918388736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601586.507131:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601586.507183:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918388736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601586.507190:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789601586.507771:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918388736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601586.833313:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601587.014047:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601587.014078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918388864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601587.014180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.014273:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388864 00000100:00100000:3.0:1789601587.014283:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388864 00000100:00100000:3.0:1789601587.014339:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789601587.014350:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918388864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601587.014392:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789601587.014444:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918388864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601587.014452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789601587.014519:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918388864:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789601587.027519:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789601587.027578:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789601587.027899:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789601587.027911:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789601587.856515:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601588.149032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601588.149138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898411904 00000100:00100000:2.0:1789601588.149163:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898411904 00000100:00100000:2.0:1789601588.149258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:2.0:1789601588.149272:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:13183:x1876532898411904:12345-192.168.203.48@tcp:101:lsof.0 00010000:00010000:2.0:1789601588.149297:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601588.149318:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f25e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e7e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601588.149393:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601588.149408:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601588.149422:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601588.149472:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789601588.149476:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601588.149517:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601588.149546:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d000/0x74872e3eca9f25e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e7e expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789601588.149577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601588.149703:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e7e expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601588.149714:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:2.0:1789601588.149731:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601588.149735:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ca00, rc 0) 00000100:00100000:2.0:1789601588.149801:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+6:13183:x1876532898411904:12345-192.168.203.48@tcp:101:lsof.0 Request processed in 534us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.149808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:1.0:1789601588.550305:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601588.550339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918388992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601588.550412:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601588.550440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918389120:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.550475:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601588.550888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389120 00000100:00100000:1.0:1789601588.550897:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389120 00000100:00100000:1.0:1789601588.550951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789601588.550960:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.551712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918388992 00000100:00100000:3.0:1789601588.551719:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918388992 00000100:00100000:3.0:1789601588.551759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789601588.551767:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.551818:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918388992:12345-0@lo:400:kworker.0 Request processed in 52us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601588.551842:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789601588.551899:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918389248:0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.551933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601588.551981:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389248 00000100:00100000:3.0:1789601588.551985:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389248 00000100:00100000:3.0:1789601588.552010:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789601588.552017:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.552055:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918389248:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601588.552061:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789601588.552278:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918389248:0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.552319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918388992:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.562723:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918389504:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.562804:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.562854:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918390016:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.562875:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.562898:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918390528:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.562915:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.562938:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789601588.562944:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918389376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.562965:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.562978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918389888:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563006:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.563021:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918390400:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.563065:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389504 00000100:00100000:2.0:1789601588.563074:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389504 00000100:00100000:2.0:1789601588.563250:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789601588.563260:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918389504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563315:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918389504:12345-0@lo:400:kworker.0 Request processed in 57us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563322:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789601588.563348:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390016 00000100:00100000:2.0:1789601588.563366:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390016 00000100:00100000:2.0:1789601588.563396:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390528 00000100:00100000:2.0:1789601588.563398:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390528 00000100:00100000:2.0:1789601588.563408:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389888 00000100:00100000:2.0:1789601588.563410:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389888 00000100:00100000:2.0:1789601588.563420:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390400 00000100:00100000:2.0:1789601588.563422:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390400 00000100:00100000:2.0:1789601588.563433:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789601588.563438:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918390016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563465:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918390016:12345-0@lo:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563471:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789601588.563480:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789601588.563484:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563510:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918390528:12345-0@lo:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563516:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789601588.563525:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789601588.563530:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918389888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563550:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918389888:12345-0@lo:400:kworker.0 Request processed in 21us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563652:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789601588.563664:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789601588.563669:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563694:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918390400:12345-0@lo:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563699:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1789601588.563725:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601588.563729:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601588.563761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918389888:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563770:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918390400:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918389504:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918390016:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918390528:0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563825:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389376 00000100:00100000:2.0:1789601588.563828:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389376 00000100:00100000:2.0:1789601588.563855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789601588.563861:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918389376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.563892:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918389376:12345-0@lo:400:kworker.0 Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.563897:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789601588.563921:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918389376:0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.564357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918389760:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.564528:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918389120:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.564769:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918389632:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.564822:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601588.564849:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.564872:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601588.565405:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389632 00000100:00100000:0.0:1789601588.565432:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389632 00000100:00100000:0.0:1789601588.565496:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390144 00000100:00100000:0.0:1789601588.565500:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390144 00000100:00100000:0.0:1789601588.565519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789601588.565526:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.565656:0:6523:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789601588.565668:0:6523:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789601588.565844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789601588.565853:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918390144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601588.565925:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876532918390144:12345-0@lo:400:kworker.0 Request processed in 74us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601588.565933:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789601588.568370:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918389632:12345-0@lo:400:kworker.0 Request processed in 2831us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601588.568387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:0.0:1789601588.568448:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601588.568888:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918389120:12345-0@lo:400:kworker.0 Request processed in 17926us (18408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601588.568897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789601588.570286:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.570352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918389632:0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.570968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601588.571047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918390272:0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.571078:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601588.571383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918389760 00000100:00100000:2.0:1789601588.571392:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918389760 00000100:00100000:2.0:1789601588.571519:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390272 00000100:00100000:2.0:1789601588.571541:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390272 00000100:00100000:0.0:1789601588.571696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789601588.571708:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918389760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601588.573832:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918389760:12345-0@lo:400:kworker.0 Request processed in 2114us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601588.573852:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00080000:3.0:1789601588.574059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff501f80 x1876532918389760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601588.574079:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918389760:0@lo:400:kworker.0 00000100:00080000:1.0:1789601588.574472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601588.575012:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789601588.575026:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918390272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601588.576909:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918390272:12345-0@lo:400:kworker.0 Request processed in 1877us (5818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601588.576946:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00080000:0.0:1789601588.577185:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4ff500380 x1876532918390272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601588.577201:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918390272:0@lo:400:kworker.0 00010000:00010000:3.0:1789601588.869818:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601589.064155:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601589.064192:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918390656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601589.064294:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601589.065233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601589.065255:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601589.065318:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601589.065357:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390656 00000100:00100000:2.0:1789601589.065364:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390656 00000100:00100000:2.0:1789601589.065414:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390784 00000100:00100000:2.0:1789601589.065417:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390784 00000100:00100000:2.0:1789601589.065433:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789601589.065440:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918390656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601589.065469:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601589.065510:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918390656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601589.065518:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789601589.065538:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789601589.065544:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918390784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601589.065553:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601589.065600:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918390784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601589.065606:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789601589.065652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601589.065735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918390656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601589.808475:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601589.809286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898412160 00000100:00100000:3.0:1789601589.809298:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898412160 00000100:00100000:3.0:1789601589.809382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:3.0:1789601589.809393:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+18:13184:x1876532898412160:12345-192.168.203.48@tcp:35:umount.0 00000100:00080000:0.0:1789601589.809407:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601589.809708:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+19:13184:x1876532898412160:12345-192.168.203.48@tcp:35:umount.0 Request processed in 316us (1240us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789601589.809717:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:1.0:1789601589.829933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601589.830253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898412416 00000100:00100000:3.0:1789601589.830267:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898412416 00000100:00100000:1.0:1789601589.830524:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:1.0:1789601589.830538:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+19:13184:x1876532898412416:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:1.0:1789601589.831168:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:13184:x1876532898412416:12345-192.168.203.48@tcp:35:umount.0 Request processed in 632us (1247us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789601589.831178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1789601589.838934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601589.839431:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898412672 00000100:00100000:1.0:1789601589.839446:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898412672 00000100:00100000:1.0:1789601589.839520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1789601589.839533:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0983c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+20:13184:x1876532898412672:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:1.0:1789601589.841219:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0983c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af09a131-8cce-462c-8c01-5d48daa688cf+21:13184:x1876532898412672:12345-192.168.203.48@tcp:35:umount.0 Request processed in 1677us (2286us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789601589.841251:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789601589.847797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601589.847878:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898412928 00000100:00100000:3.0:1789601589.847892:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898412928 00000100:00100000:3.0:1789601589.847981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:3.0:1789601589.847994:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:13184:x1876532898412928:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:3.0:1789601589.848391:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af09a131-8cce-462c-8c01-5d48daa688cf+22:13184:x1876532898412928:12345-192.168.203.48@tcp:35:umount.0 Request processed in 399us (611us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789601589.848401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789601589.853357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601589.853392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601589.853420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601589.853853:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898413056 00000100:00100000:1.0:1789601589.853872:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898413056 00000100:00100000:3.0:1789601589.854049:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898413312 00000100:00100000:1.0:1789601589.854050:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898413184 00000100:00100000:3.0:1789601589.854054:0:7465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898413312 00000100:00100000:1.0:1789601589.854054:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898413184 00000100:00100000:3.0:1789601589.854092:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789601589.854106:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26752b1e-2ce1-4365-8a20-41d46cc3fa32+15:2418:x1876532898413056:12345-192.168.203.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789601589.854138:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1789601589.854147:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+15:2418:x1876532898413184:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601589.854172:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601589.854198:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363600/0x74872e3eca9f1517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48999 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.854228:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601589.854294:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+14:2418:x1876532898413184:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 148us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601589.854302:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1789601589.854322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789601589.854340:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+13:2418:x1876532898413312:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601589.854348:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601589.854357:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383600/0x74872e3eca9f17ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ab1 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.854367:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601589.854385:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:2418:x1876532898413312:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 57us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601589.854390:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789601589.854534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601589.854703:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898413696 00000100:00100000:1.0:1789601589.854708:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898413696 00000100:00100000:1.0:1789601589.854765:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:1.0:1789601589.854773:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+7:2414:x1876532898413696:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:1.0:1789601589.854805:0:8857:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1b68 00000020:00010000:1.0:1789601589.854815:0:8857:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df3c4009800: total 0 00000100:00080000:1.0:1789601589.854821:0:8857:0:(import.c:65:import_set_state_nolock()) ffff8df3c400a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789601589.854880:0:8857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789601589.855093:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898413696:12345-192.168.203.48@tcp:9:umount.0 Request processed in 320us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601589.855101:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000020:00010000:1.0:1789601589.855120:0:7464:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df3c4009800: total 0 00010000:00010000:1.0:1789601589.855144:0:7464:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df3c4009800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789601589.855196:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa65020/0x74872e3eca9f1f20 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c9b expref: 4 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.855232:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f25e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e77 expref: 3 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.855249:0:7464:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df3c4009800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789601589.855261:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601589.855264:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601589.855265:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789601589.855283:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789601589.856775:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601589.856805:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f15d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489d8 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601589.856822:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601589.856887:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2418:x1876532898413056:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 2783us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601589.856896:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1789601589.884066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601589.884236:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898413824 00000100:00100000:2.0:1789601589.884249:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898413824 00000100:00100000:2.0:1789601589.884382:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:2.0:1789601589.884397:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898413824:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:2.0:1789601589.884440:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f18f2 00000100:00080000:2.0:1789601589.884452:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c400b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601589.884521:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1789601589.884878:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601589.884890:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af09a131-8cce-462c-8c01-5d48daa688cf+2:2414:x1876532898413824:12345-192.168.203.48@tcp:9:umount.0 Request processed in 496us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601589.884899:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00080000:1.0:1789601589.885028:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601589.894050:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601589.906803:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601589.909230:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898414848 00000100:00100000:0.0:1789601589.909248:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898414848 00000100:00100000:0.0:1789601589.909362:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 257 00000100:00100000:0.0:1789601589.909375:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+22:2414:x1876532898414848:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:0.0:1789601589.909423:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1525 00000020:00010000:0.0:1789601589.909446:0:6521:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df3c2aff000: total 0 00000100:00080000:0.0:1789601589.909452:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8df3c2af9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601589.909536:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789601589.909806:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af09a131-8cce-462c-8c01-5d48daa688cf+21:2414:x1876532898414848:12345-192.168.203.48@tcp:39:umount.0 Request processed in 433us (3021us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789601589.909814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 257 00000020:00010000:1.0:1789601589.910269:0:7464:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df3c2aff000: total 0 00010000:00010000:1.0:1789601589.910344:0:7464:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df3c2aff000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789601589.910384:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df4f5eb2900) 00010000:00010000:1.0:1789601589.910388:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601589.910398:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1529a00/0x74872e3eca9f1851 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48abf expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910426:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601589.910428:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601589.910432:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c3467a00/0x74872e3eca9f24c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e2a expref: 19 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910446:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601589.910448:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601589.910452:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e0a00/0x74872e3eca9f1e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c4e expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910466:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601589.910468:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789601589.910472:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528c00/0x74872e3eca9f1f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb7 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910486:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601589.910489:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789601589.910492:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f73ef800/0x74872e3eca9f18c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48adb expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910504:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601589.910506:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601589.910517:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ce00/0x74872e3eca9f25a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e62 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910534:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4c4dbc900) 00010000:00010000:1.0:1789601589.910536:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601589.910540:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f186d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ac6 expref: 14 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910593:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601589.910596:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601589.910600:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1528400/0x74872e3eca9f1ee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c86 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910615:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df501e4f400) 00010000:00010000:1.0:1789601589.910617:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789601589.910621:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382c00/0x74872e3eca9f1f0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48c94 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910636:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df4e0d94200) 00010000:00010000:1.0:1789601589.910639:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601589.910642:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c0031a00/0x74872e3eca9f1bc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48bb4 expref: 11 pid: 9040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910660:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:1.0:1789601589.910662:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601589.910666:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5021e1200/0x74872e3eca9f1f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48cb0 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910680:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df4f73dd800) 00010000:00010000:1.0:1789601589.910688:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789601589.910694:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4c1679600/0x74872e3eca9f25cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e70 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910715:0:7464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df4c3beb500) 00010000:00010000:1.0:1789601589.910718:0:7464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601589.910722:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383c00/0x74872e3eca9f2284 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48d90 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601589.910736:0:7464:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df3c2aff000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789601589.910750:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601589.910753:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601589.910755:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601589.922106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601589.922222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898414976 00000100:00100000:2.0:1789601589.922235:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898414976 00000100:00100000:2.0:1789601589.922441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 258 00000100:00100000:2.0:1789601589.922453:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+5:2414:x1876532898414976:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:2.0:1789601589.922504:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f152c 00000100:00080000:2.0:1789601589.922531:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8df3c2add800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789601589.922743:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1789601589.924881:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789601589.925138:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af09a131-8cce-462c-8c01-5d48daa688cf+3:2414:x1876532898414976:12345-192.168.203.48@tcp:39:umount.0 Request processed in 2680us (3039us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789601589.925151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 258 00010000:00010000:0.0:1789601589.928937:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601590.049239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601590.049294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601590.049384:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415104 00000100:00100000:0.0:1789601590.049397:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415104 00000100:00100000:0.0:1789601590.049477:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415232 00000100:00100000:0.0:1789601590.049481:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415232 00000100:00100000:0.0:1789601590.049512:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 373 00000100:00100000:0.0:1789601590.049524:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898415104:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601590.049664:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2415:x1876532898415104:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 141us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601590.049672:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 373 00000100:00100000:0.0:1789601590.049692:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 374 00000100:00100000:0.0:1789601590.049699:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898415232:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601590.049725:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2415:x1876532898415232:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601590.049732:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 374 00000100:00080000:1.0:1789601590.050177:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789601590.050183:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601590.599200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918390912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601590.599308:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601590.600114:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601590.600129:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918391040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601590.600173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601590.600405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918390912 00000100:00100000:1.0:1789601590.600416:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918390912 00000100:00100000:1.0:1789601590.600500:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391040 00000100:00100000:1.0:1789601590.600503:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391040 00000100:00100000:1.0:1789601590.600527:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789601590.600538:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918390912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601590.600608:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789601590.600663:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918390912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601590.600895:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918390912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789601590.600921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601590.601015:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789601590.601037:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789601590.601060:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918391040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601590.601072:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789601590.601133:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918391040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601590.601139:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789601590.601267:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918391040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789601590.918325:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601591.621883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601591.621919:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918391168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601591.621994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601591.622199:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391168 00000100:00100000:0.0:1789601591.622233:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391168 00000100:00100000:0.0:1789601591.622286:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789601591.622295:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918391168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601591.622327:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789601591.622382:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918391168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601591.622389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789601591.622696:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918391168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601591.942021:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601592.133882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918391296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601592.133977:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601592.134489:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391296 00000100:00100000:3.0:1789601592.134501:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391296 00000100:00100000:3.0:1789601592.134583:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789601592.134594:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918391296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601592.134667:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789601592.134750:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918391296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601592.134758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789601592.134869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918391296:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789601592.326434:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789601592.840179:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601592.840190:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601592.840334:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789601592.840342:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789601592.966398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601593.309277:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601593.309324:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601593.309368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601593.309472:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415488 00000100:00100000:2.0:1789601593.309485:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415488 00000100:00100000:2.0:1789601593.309611:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415360 00000100:00100000:2.0:1789601593.309616:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415360 00000100:00100000:2.0:1789601593.309631:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415616 00000100:00100000:2.0:1789601593.309634:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415616 00000100:00100000:2.0:1789601593.309651:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1789601593.309663:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+12:2416:x1876532898415488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601593.309703:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601593.309739:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f162f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48a1e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601593.309760:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601593.309824:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+11:2416:x1876532898415488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 163us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601593.309832:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1789601593.309859:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789601593.309870:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2415:x1876532898415360:12345-192.168.203.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789601593.309870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00010000:00010000:2.0:1789601593.309883:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789601593.309889:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f3639450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+10:2417:x1876532898415616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601593.309895:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363000/0x74872e3eca9f1628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489ed expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601593.309902:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601593.309907:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601593.309918:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362e00/0x74872e3eca9f17e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48aaa expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601593.309931:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601593.309947:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:2415:x1876532898415360:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 80us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601593.309955:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601593.309961:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f3639450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26752b1e-2ce1-4365-8a20-41d46cc3fa32+8:2417:x1876532898415616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 77us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.309970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601593.330115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601593.330250:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898415872 00000100:00100000:2.0:1789601593.330263:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898415872 00000100:00100000:2.0:1789601593.330390:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 259 00000100:00100000:2.0:1789601593.330403:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a1d2becd-b915-45a6-b68d-98afb78edf03+6:2414:x1876532898415872:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:2.0:1789601593.330458:0:14968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f163d 00000020:00010000:2.0:1789601593.330468:0:14968:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df3c298a000: total 0 00000100:00080000:2.0:1789601593.330474:0:14968:0:(import.c:65:import_set_state_nolock()) ffff8df3c298b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601593.330513:0:14968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789601593.330764:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2414:x1876532898415872:12345-192.168.203.48@tcp:39:umount.0 Request processed in 363us (663us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789601593.330788:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 259 00000020:00010000:1.0:1789601593.331182:0:6510:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df3c298a000: total 0 00010000:00010000:1.0:1789601593.331188:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601593.331251:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df3c298a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789601593.331291:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df4f8af9f00) 00010000:00010000:1.0:1789601593.331293:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601593.331303:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737ca00/0x74872e3eca9f25ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e7e expref: 4 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601593.331321:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df3c298a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789601593.331328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601593.331330:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601593.331331:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601593.333322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601593.337766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601593.337834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416000 00000100:00100000:0.0:1789601593.337848:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416000 00000100:00080000:3.0:1789601593.338182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601593.338233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 260 00000100:00100000:0.0:1789601593.338256:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+5:2414:x1876532898416000:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:0.0:1789601593.338319:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1644 00000100:00080000:0.0:1789601593.338332:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8df3c23db800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601593.338375:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789601593.338641:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1d2becd-b915-45a6-b68d-98afb78edf03+3:2414:x1876532898416000:12345-192.168.203.48@tcp:39:umount.0 Request processed in 389us (933us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789601593.338649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 260 00010000:00010000:1.0:1789601593.338697:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601593.375810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601593.375906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416256 00000100:00100000:0.0:1789601593.375920:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416256 00000100:00100000:0.0:1789601593.375996:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 400 00000100:00100000:0.0:1789601593.376008:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+7:2414:x1876532898416256:12345-192.168.203.48@tcp:251:umount.0 00000020:00000080:0.0:1789601593.376186:0:6515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1502 00000020:00010000:0.0:1789601593.376196:0:6515:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df3c2adf000: total 0 00000100:00080000:0.0:1789601593.376202:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df3c2ad8800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789601593.376366:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:26752b1e-2ce1-4365-8a20-41d46cc3fa32+3:2414:x1876532898416256:12345-192.168.203.48@tcp:251:umount.0 Request processed in 359us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.376375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 400 00000020:00010000:1.0:1789601593.376521:0:6509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df3c2adf000: total 0 00010000:00010000:1.0:1789601593.376621:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df3c2adf000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789601593.376659:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73eea00/0x74872e3eca9f15db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a489df expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601593.376698:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df3c2adf000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789601593.376709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601593.376712:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601593.376713:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789601593.376853:0:6515:0:(genops.c:885:class_export_put()) final put ffff8df3c2adf000/26752b1e-2ce1-4365-8a20-41d46cc3fa32 00000020:00000080:1.0:1789601593.379593:0:13926:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2adf000/26752b1e-2ce1-4365-8a20-41d46cc3fa32 for MGS 00000020:00000080:1.0:1789601593.379656:0:13926:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2ad8800 for MGS 00000100:00100000:1.0:1789601593.674389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918391552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601593.674477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601593.674536:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918392064:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.674733:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.674774:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.674802:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918391936:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.674827:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.674846:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918392448:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.674870:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.675029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918392960:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675074:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.675123:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391424 00000100:00100000:0.0:1789601593.675132:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391424 00000100:00100000:0.0:1789601593.675187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789601593.675197:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675248:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918391424:12345-0@lo:400:kworker.0 Request processed in 53us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.675255:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789601593.675287:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391936 00000100:00100000:0.0:1789601593.675291:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391936 00000100:00100000:0.0:1789601593.675316:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789601593.675321:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918391936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675351:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918391936:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.675357:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789601593.675374:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392448 00000100:00100000:0.0:1789601593.675377:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392448 00000100:00100000:0.0:1789601593.675412:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392960 00000100:00100000:0.0:1789601593.675414:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392960 00000100:00100000:0.0:1789601593.675432:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789601593.675438:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675464:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918392448:12345-0@lo:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.675470:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789601593.675479:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789601593.675485:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675507:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918392960:12345-0@lo:400:kworker.0 Request processed in 22us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.675518:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1789601593.675545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601593.675550:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601593.675705:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675779:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918391936:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675788:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918392448:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675796:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918392960:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675845:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918391680:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.675871:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.675993:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d0158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918392192:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.676034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918392704:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.676085:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789601593.676091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918391808:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.676133:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918392320:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.676170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918392832:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601593.676214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391680 00000100:00100000:0.0:1789601593.676217:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391680 00000100:00100000:0.0:1789601593.676241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789601593.676253:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918391680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676286:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918391680:12345-0@lo:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.676293:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789601593.676310:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391552 00000100:00100000:0.0:1789601593.676313:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391552 00000100:00100000:0.0:1789601593.676334:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392192 00000100:00100000:0.0:1789601593.676337:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392192 00000100:00100000:0.0:1789601593.676351:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392704 00000100:00100000:0.0:1789601593.676353:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392704 00000100:00100000:0.0:1789601593.676364:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918391808 00000100:00100000:0.0:1789601593.676366:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918391808 00000100:00100000:0.0:1789601593.676380:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789601593.676385:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918391552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676412:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918391552:12345-0@lo:400:kworker.0 Request processed in 27us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.676418:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789601593.676428:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789601593.676433:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918392192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676454:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918392192:12345-0@lo:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.676460:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789601593.676469:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789601593.676474:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918392704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676496:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918392704:12345-0@lo:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601593.676501:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789601593.676517:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789601593.676522:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.676549:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918391808:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601593.676706:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601593.676737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918392576:0@lo:400:kworker.0 00000100:00100000:1.0:1789601593.676761:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601593.676787:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918391552:0@lo:400:kworker.0 00000100:00100000:2.0:1789601593.676996:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392320 00000100:00100000:2.0:1789601593.677001:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392320 00000100:00100000:2.0:1789601593.677029:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392832 00000100:00100000:2.0:1789601593.677031:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392832 00000100:00100000:2.0:1789601593.677045:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601593.677064:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918392320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601593.677099:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918392320:12345-0@lo:400:kworker.0 Request processed in 47us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601593.677105:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601593.677121:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789601593.677140:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918392832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601593.677167:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918392832:12345-0@lo:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601593.677172:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789601593.677189:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392064 00000100:00100000:2.0:1789601593.677192:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392064 00000100:00100000:1.0:1789601593.677528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918392576 00000100:00100000:1.0:1789601593.677533:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918392576 00000100:00100000:0.0:1789601593.677969:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:0.0:1789601593.677992:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601593.677996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601593.677999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601593.678002:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601593.678036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918391808:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.678048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918392320:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.678074:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918392832:0@lo:400:kworker.0 00000100:00100000:0.0:1789601593.678085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918391680:0@lo:400:kworker.0 00010000:00080000:0.0:1789601593.678101:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d0158e00 x1876532918392192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601593.678112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d0158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918392192:0@lo:400:kworker.0 00010000:00080000:0.0:1789601593.678123:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c359f800 x1876532918392704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601593.678131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918392704:0@lo:400:kworker.0 00000100:00100000:2.0:1789601593.678315:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789601593.678324:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601593.678378:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918392064:12345-0@lo:400:kworker.0 Request processed in 55us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601593.678384:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789601593.678515:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918392064:0@lo:400:kworker.0 00000100:00100000:1.0:1789601593.678873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789601593.678989:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918392576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601593.679046:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918392576:12345-0@lo:400:kworker.0 Request processed in 165us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601593.679060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789601593.679126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918392576:0@lo:400:kworker.0 00010000:00010000:1.0:1789601593.992850:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601594.182766:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918393088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601594.182871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601594.182990:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393088 00000100:00100000:0.0:1789601594.183016:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393088 00000100:00100000:0.0:1789601594.183085:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601594.183097:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918393088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601594.183137:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789601594.183188:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918393088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601594.183196:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789601594.183254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918393088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601594.183813:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601594.183827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918393216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601594.183867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601594.184065:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393216 00000100:00100000:2.0:1789601594.184080:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393216 00000100:00100000:2.0:1789601594.184121:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789601594.184129:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918393216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601594.184142:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601594.184180:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918393216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601594.184187:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789601594.184722:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918393216:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601595.014938:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789601595.519461:0:15056:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789601595.532605:0:15056:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789601595.532669:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.532684:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.532693:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.532700:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.532723:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789601595.532729:0:15056:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789601595.532756:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601595.532760:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789601595.532766:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789601595.532802:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789601595.532894:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.532907:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.532919:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601595.532924:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.532935:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601595.532943:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601595.532949:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601595.532952:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789601595.532956:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789601595.532997:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.533078:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601595.533125:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.533134:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382e00/0x74872e3eca9f15aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.533146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.533148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.533151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601595.533172:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918393344:0@lo:39:umount.0 00000100:00100000:0.0:1789601595.533258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.533338:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601595.533348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.533379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.533421:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393344 00000100:00100000:0.0:1789601595.533429:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393344 00000100:00100000:0.0:1789601595.533488:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789601595.533578:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876532918393344:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789601595.533612:0:6523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1119 00000100:00080000:0.0:1789601595.533633:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8df4f8b05000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789601595.535209:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d0158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1876532918393344:12345-0@lo:39:umount.0 Request processed in 1648us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.535222:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1789601595.535238:0:6523:0:(genops.c:885:class_export_put()) final put ffff8df4f8b01000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1789601595.535282:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393472 00000100:00100000:0.0:1789601595.535289:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393472 00000100:00100000:0.0:1789601595.535346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601595.535368:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3647:x1876532918393472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601595.535383:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601595.535422:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363c00/0x74872e3eca9f15b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f15aa expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.535440:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601595.535481:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3647:x1876532918393472:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.535489:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:0.0:1789601595.536114:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8b01000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789601595.536174:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f8b05000 for lustre-MDT0000 00000100:00100000:0.0:1789601595.536221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393472:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789601595.536265:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789601595.536279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918393344:0@lo:39:umount.0 00010000:00010000:0.0:1789601595.536773:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601595.536850:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601595.536856:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789601595.536862:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789601595.541308:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.541804:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.541812:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.541820:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.542582:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601595.542593:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.542603:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.542609:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.542615:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547095:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601595.547117:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547132:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601595.547137:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547150:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601595.547159:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601595.547165:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601595.547178:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789601595.547226:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547234:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601595.547261:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547269:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee800/0x74872e3eca9f15b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547283:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.547287:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547293:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601595.547296:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547304:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601595.547321:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601595.547327:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601595.547330:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789601595.547343:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547350:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601595.547364:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547372:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.547373:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.547375:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601595.547398:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918393600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.547480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.547740:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601595.547749:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918393728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.547779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.547825:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393600 00000100:00100000:0.0:1789601595.547833:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393600 00000100:00100000:0.0:1789601595.547885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393728 00000100:00100000:0.0:1789601595.547888:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393728 00000100:00100000:0.0:1789601595.547911:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601595.547920:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+24:3645:x1876532918393600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601595.547936:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601595.547953:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7383000/0x74872e3eca9f15bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f15b8 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.547968:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601595.548090:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+23:3645:x1876532918393600:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.548098:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601595.548120:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601595.548127:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3645:x1876532918393728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601595.548134:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601595.548151:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382800/0x74872e3eca9f14c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f14bc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.548162:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601595.548186:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3645:x1876532918393728:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.548193:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601595.548242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918393728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.548252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918393600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601595.551744:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789601595.551777:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362000/0x74872e3eca9f14bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f14c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601595.551802:0:15056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789601595.551817:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551828:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551836:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551844:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551860:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601595.551867:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551874:0:15056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551882:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551889:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.551900:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789601595.551904:0:15056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789601595.551914:0:15056:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789601595.552154:0:15056:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789601595.552159:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789601595.552170:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601595.552178:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789601595.552186:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df4ccc2e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601595.552193:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df501e63000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601595.552198:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df4ccc55800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601595.552202:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df501fcd000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789601595.552211:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8df3c298a000 a1d2becd-b915-45a6-b68d-98afb78edf03 192.168.203.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601595.552215:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8df3c2aff000 af09a131-8cce-462c-8c01-5d48daa688cf 192.168.203.48@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1789601595.552221:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8df4d80919c0) has exports, disconnecting them 00000020:00080000:3.0:1789601595.552227:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df4ccc2e800), last request at 1789601593 00000020:00000080:3.0:1789601595.552235:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1429 00000100:00080000:3.0:1789601595.552256:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789601595.552307:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4ccc2e800): rc 0 00000020:00000080:3.0:1789601595.552310:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc2e800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1789601595.552409:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601595.552419:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552428:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601595.552432:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552443:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601595.552451:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601595.552458:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789601595.552461:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789601595.552463:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789601595.552625:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601595.552633:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.552640:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5021e1600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601595.552643:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.552652:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601595.552658:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601595.552664:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601595.552666:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789601595.552669:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789601595.552696:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.552702:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601595.552718:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552726:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601595.552736:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552746:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552756:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee600/0x74872e3eca9f1820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1827 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.552763:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df5021e1600/0x74872e3eca9f1078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f107f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.552774:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.552777:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.552781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.552781:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.552785:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.552789:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.552798:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601595.552803:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.552889:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601595.552958:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393856 00000100:00100000:0.0:1789601595.552958:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601595.552965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601595.552969:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393856 00000100:00100000:0.0:1789601595.552993:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789601595.554216:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df501e63000), last request at 1789601593 00000020:00000080:3.0:1789601595.554226:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1303 00000100:00080000:3.0:1789601595.554240:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df501e66000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789601595.554281:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df501e63000): rc 0 00000020:00000080:3.0:1789601595.554284:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df501e63000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789601595.554291:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df4ccc55800), last request at 1789601351 00000020:00000080:3.0:1789601595.554295:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1200 00000100:00080000:3.0:1789601595.554299:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc54000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789601595.555161:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4ccc55800): rc 0 00000020:00000080:3.0:1789601595.555166:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc55800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789601595.555198:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df501fcd000), last request at 1789601351 00000020:00000080:3.0:1789601595.555204:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f11c1 00000100:00080000:3.0:1789601595.555210:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df501fcc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601595.555227:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00000080:0.0:1789601595.555491:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc2e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789601595.556772:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df501e63000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789601595.556803:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc55800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789601595.556826:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4ccc2a000 for lustre-MDT0000 00000020:00000080:0.0:1789601595.556832:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df501e66000 for lustre-MDT0000 00000020:00000080:0.0:1789601595.556835:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4ccc54000 for lustre-MDT0000 00000020:00080000:3.0:1789601595.557168:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df501fcd000): rc 0 00000004:00000080:3.0:1789601595.557179:0:15056:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa27c81677ae0 00000100:00080000:3.0:1789601595.557203:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789601595.557208:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789601595.558012:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918393984 00000100:00100000:2.0:1789601595.558026:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918393984 00000100:00100000:2.0:1789601595.558102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601595.558115:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+22:3647:x1876532918393856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601595.558135:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601595.558158:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1529800/0x74872e3eca9f107f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1078 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.558177:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601595.558266:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+21:3647:x1876532918393856:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601595.558274:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601595.558299:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601595.558305:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+20:3647:x1876532918393984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601595.558314:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601595.558322:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef200/0x74872e3eca9f1827 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1820 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.558349:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601595.558375:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3647:x1876532918393984:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (5381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601595.558382:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789601595.558407:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.558414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.558594:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601595.559397:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789601595.559430:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4f7157000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789601595.559725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394112:0@lo:39:umount.0 00000100:00100000:2.0:1789601595.559779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601595.560183:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789601595.560189:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789601595.560207:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789601595.560278:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789601595.560293:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789601595.560302:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789601595.560304:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000001:00100000:1.0:1789601595.560671:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00080000:1.0:1789601595.560686:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789601595.560693:0:6500:0:(genops.c:885:class_export_put()) final put ffff8df3c298a000/a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00100000:1.0:1789601595.560713:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000001:00080000:1.0:1789601595.560730:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789601595.560739:0:6500:0:(genops.c:885:class_export_put()) final put ffff8df3c2aff000/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:1.0:1789601595.560754:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c298a000/a1d2becd-b915-45a6-b68d-98afb78edf03 for lustre-MDT0000 00000020:00000080:1.0:1789601595.560801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2aff000/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-MDT0000 00000020:00000080:1.0:1789601595.560842:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c298b800 for lustre-MDT0000 00000020:00000080:1.0:1789601595.560848:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2af9000 for lustre-MDT0000 00000004:00080000:3.0:1789601595.561207:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789601595.561269:0:15056:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789601595.561288:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df3c2af8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789601595.561341:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8df4d80919c0) has no exports 00000100:00100000:0.0:1789601595.564207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.564228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918393856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601595.565723:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394112 00000100:00100000:2.0:1789601595.565728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394240:0@lo:9:umount.0 00000100:00100000:0.0:1789601595.565736:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394112 00000100:00100000:0.0:1789601595.565801:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789601595.565807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.565817:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876532918394112:12345-0@lo:39:umount.0 00000100:00100000:2.0:1789601595.565836:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394368:0@lo:9:umount.0 00000100:00100000:2.0:1789601595.565867:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789601595.565883:0:6527:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1270 00000100:00080000:0.0:1789601595.565896:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8df4f8d3d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601595.565928:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789601595.565976:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394240 00000100:00100000:2.0:1789601595.565991:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394368 00000100:00100000:1.0:1789601595.565992:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394240 00000100:00100000:2.0:1789601595.566000:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394368 00000100:00100000:2.0:1789601595.566066:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601595.566075:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876532918394368:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789601595.566092:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f14ed 00000100:00080000:2.0:1789601595.566099:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c354c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601595.566143:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789601595.566290:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1876532918394368:12345-0@lo:9:umount.0 Request processed in 215us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601595.566298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1789601595.566327:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789601595.566356:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2af8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789601595.566369:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789601595.566371:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789601595.566386:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394368:0@lo:9:umount.0 00000100:00100000:0.0:1789601595.567270:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1876532918394112:12345-0@lo:39:umount.0 Request processed in 1453us (7484us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789601595.567281:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00010000:0.0:1789601595.567328:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601595.567362:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7157000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789601595.567372:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394112:0@lo:39:umount.0 00000100:00100000:1.0:1789601595.569294:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601595.569321:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876532918394240:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789601595.569358:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f13ab 00000100:00080000:1.0:1789601595.569369:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789601595.569423:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789601595.569618:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1876532918394240:12345-0@lo:9:umount.0 Request processed in 312us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601595.569625:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789601595.571243:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601595.571263:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789601595.571508:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789601595.571553:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789601595.571583:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789601595.571586:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789601595.571591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918394240:0@lo:9:umount.0 00000001:00100000:2.0:1789601595.577488:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601595.577825:0:8434:0:(genops.c:885:class_export_put()) final put ffff8df4ccc2b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789601595.577846:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:2.0:1789601595.577849:0:8434:0:(genops.c:885:class_export_put()) final put ffff8df3c400e000/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:1.0:1789601595.579738:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc2b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789601595.579805:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c400e000/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-OST0000 00000020:00000080:1.0:1789601595.579825:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4ccc2c000 for lustre-OST0000 00000020:00000080:1.0:1789601595.579829:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c400b000 for lustre-OST0000 00000001:00100000:0.0:1789601595.583010:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789601595.583022:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df4f8d3f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789601595.583056:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:0.0:1789601595.583059:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df3c4009800/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:2.0:1789601595.583091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8d3f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789601595.583230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c4009800/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-OST0001 00000001:00100000:3.0:1789601595.583370:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789601595.583383:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789601595.583388:0:7453:0:(genops.c:885:class_export_put()) final put ffff8df4f70a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601595.583397:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c354c800 for lustre-OST0001 00000001:00100000:3.0:1789601595.583410:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00080000:3.0:1789601595.583416:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789601595.583418:0:7453:0:(genops.c:885:class_export_put()) final put ffff8df3c2989000/a1d2becd-b915-45a6-b68d-98afb78edf03 00000001:00100000:3.0:1789601595.583424:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af09a131-8cce-462c-8c01-5d48daa688cf 00000001:00080000:3.0:1789601595.583445:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789601595.583447:0:7453:0:(genops.c:885:class_export_put()) final put ffff8df3c2adc800/af09a131-8cce-462c-8c01-5d48daa688cf 00000020:00000080:2.0:1789601595.583452:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c400a000 for lustre-OST0001 00000020:00000080:2.0:1789601595.583842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f70a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789601595.584172:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2989000/a1d2becd-b915-45a6-b68d-98afb78edf03 for lustre-MDT0001 00000020:00000080:2.0:1789601595.584378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2adc800/af09a131-8cce-462c-8c01-5d48daa688cf for lustre-MDT0001 00000020:00000080:2.0:1789601595.584821:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f8d3d000 for lustre-MDT0001 00000020:00000080:2.0:1789601595.584829:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c23db800 for lustre-MDT0001 00000020:00000080:2.0:1789601595.584835:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2add800 for lustre-MDT0001 00000020:00080000:3.0:1789601595.591796:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8df4d80919c0) has no exports 00000100:00100000:2.0:1789601595.720146:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918394496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601595.720243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789601595.720276:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f10d3 00000020:00000080:3.0:1789601595.720293:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc51800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789601595.720314:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000100:00100000:2.0:1789601595.720356:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394496 00000100:00100000:2.0:1789601595.720367:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394496 00000100:00080000:3.0:1789601595.720435:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601595.720461:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789601595.720473:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918394496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601595.720510:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789601595.720590:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918394496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601595.720597:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000020:00000080:2.0:1789601595.720632:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc51800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789601595.720658:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601595.720687:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789601595.720693:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8df4d09ccd40) has no exports 00000020:00000080:2.0:1789601595.722839:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f10cc 00000020:00000080:2.0:1789601595.722857:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4cd0dd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789601595.722969:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601595.722982:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789601595.722986:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4cd0d8000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789601595.722989:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0d8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789601595.722995:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789601595.723631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789601595.725334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918394496:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789601596.037824:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601597.061899:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601597.258922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601597.259016:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601597.259315:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394624 00000100:00100000:1.0:1789601597.259342:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394624 00000100:00100000:1.0:1789601597.259402:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789601597.259411:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876532918394624:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1789601597.259421:0:7934:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789601597.259732:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876532918394624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 319us (714us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601597.259741:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:02020000:2.0:1789601597.260886:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789601597.290798:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789601597.290807:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789601597.290812:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789601597.307005:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601597.307023:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:2.0:1789601597.307051:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df4f8da7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601597.307134:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4ff501500 x1876532918394752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601597.307309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918394752:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789601597.307396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601597.308128:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394752 00000100:00100000:2.0:1789601597.308139:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394752 00000100:00100000:2.0:1789601597.308187:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789601597.308196:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918394752:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789601597.308216:0:6526:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789601597.311942:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918394752:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3736us (4536us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789601597.311959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1789601597.312159:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601597.312166:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789601597.312172:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918394752:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789601598.087828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601598.789837:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789601598.789846:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789601598.789851:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601598.789880:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1789601598.789888:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789601598.789912:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df4f8da7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601598.789959:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c3427800 x1876532918395008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601598.790374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918395008:0@lo:38:kworker.0 00000100:00100000:1.0:1789601598.790474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601598.790746:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395008 00000100:00100000:0.0:1789601598.790756:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395008 00000100:00100000:0.0:1789601598.790806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789601598.790816:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876532918395008:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789601598.790837:0:6527:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789601598.791597:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918395264:0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.791656:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601598.791706:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918395776:0@lo:400:kworker.0 00000100:00100000:1.0:1789601598.791805:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395264 00000100:00100000:1.0:1789601598.791813:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395264 00000100:00100000:1.0:1789601598.791856:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789601598.791863:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1876532918395264:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789601598.791871:0:9040:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789601598.792125:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1876532918395264:12345-0@lo:400:kworker.0 Request processed in 62us (268us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601598.792134:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789601598.792193:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918394880:0@lo:400:kworker.0 00000100:00100000:1.0:1789601598.792232:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601598.792256:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918395520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601598.792283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601598.792306:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789601598.792313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918395136:0@lo:400:kworker.0 00000100:00100000:1.0:1789601598.792336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601598.792355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918395648:0@lo:400:kworker.0 00000100:00100000:1.0:1789601598.792373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601598.792416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395136 00000100:00100000:1.0:1789601598.792420:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395136 00000100:00100000:1.0:1789601598.792441:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395648 00000100:00100000:1.0:1789601598.792443:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395648 00000100:00100000:1.0:1789601598.792456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789601598.792467:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1876532918395136:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789601598.792473:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789601598.792503:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1876532918395136:12345-0@lo:400:kworker.0 Request processed in 41us (166us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601598.792509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789601598.792523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789601598.792526:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1876532918395648:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789601598.792531:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789601598.792552:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1876532918395648:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601598.792585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789601598.792629:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789601598.792635:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789601598.792640:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789601598.792735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918394880 00000100:00100000:3.0:1789601598.792740:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918394880 00000100:00100000:3.0:1789601598.792780:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789601598.792787:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3647:x1876532918394880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601598.792833:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ae79c1b-f0a7-456b-b85e-4e644036ec22+19:3647:x1876532918394880:12345-0@lo:400:kworker.0 Request processed in 47us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601598.792839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789601598.793951:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789601598.794028:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789601598.794149:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789601598.794156:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789601598.794162:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601598.794168:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 239 00000100:00080000:2.0:1789601598.794180:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df3c19cc800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601598.794220:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4ff500000 x1876532918396032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601598.794249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918395264:0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794271:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789601598.794281:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918395392:0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794316:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601598.794337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918395904:0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601598.794405:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395520 00000100:00100000:2.0:1789601598.794411:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395520 00000100:00100000:2.0:1789601598.794475:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395904 00000100:00100000:2.0:1789601598.794479:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395904 00000100:00100000:2.0:1789601598.794502:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789601598.794510:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918395520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794575:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918395520:12345-0@lo:400:kworker.0 Request processed in 47us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601598.794597:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789601598.794616:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789601598.794621:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918395904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794656:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918395904:12345-0@lo:400:kworker.0 Request processed in 35us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601598.794663:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789601598.794691:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395776 00000100:00100000:2.0:1789601598.794695:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395776 00000100:00100000:2.0:1789601598.794734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918395392 00000100:00100000:2.0:1789601598.794737:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918395392 00000100:00100000:2.0:1789601598.794759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789601598.794765:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918395776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794797:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918395776:12345-0@lo:400:kworker.0 Request processed in 32us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601598.794802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789601598.794813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789601598.794819:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918395392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794846:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918395392:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601598.794851:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:2.0:1789601598.794898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4067480 x1876532918395392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601598.794910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918395392:0@lo:400:kworker.0 00000100:00100000:2.0:1789601598.794921:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918395904:0@lo:400:kworker.0 00010000:00080000:2.0:1789601598.794929:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c4065180 x1876532918395776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789601598.795186:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601598.795192:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601598.795194:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601598.795310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918396032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789601598.795348:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601598.795386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396032 00000100:00100000:3.0:1789601598.795390:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396032 00000100:00100000:3.0:1789601598.795409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789601598.795413:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876532918396032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789601598.795429:0:6522:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789601598.795461:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876532918396032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 47us (113us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789601598.795467:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789601598.795505:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601598.795510:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601598.795513:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918396032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789601598.799184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918395776:0@lo:400:kworker.0 00000100:00100000:0.0:1789601598.810855:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876532918395008:12345-0@lo:38:kworker.0 Request processed in 20029us (20383us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789601598.813592:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601598.813605:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601598.813611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918395008:0@lo:38:kworker.0 00000100:00100000:0.0:1789601598.813836:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1789601598.838507:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601598.838524:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:1.0:1789601598.847740:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df4f70a0000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601598.848094:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4064a80 x1876532918396160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601598.848134:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918395136:0@lo:400:kworker.0 00000100:00080000:0.0:1789601598.848179:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789601598.848185:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789601598.848189:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789601598.848194:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601598.848199:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 262 00000100:00080000:0.0:1789601598.848206:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df4f7392000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601598.848220:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4064380 x1876532918396288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601598.848230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876532918395648:0@lo:400:kworker.0 00000100:00100000:0.0:1789601598.848266:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3647:1876532918394880:0@lo:400:kworker.0 00000100:00100000:0.0:1789601598.848285:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918395520:0@lo:400:kworker.0 00000100:00100000:3.0:1789601598.848433:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918396160:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789601598.848510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601598.848633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918396288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789601598.848656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601598.848855:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396160 00000100:00100000:1.0:1789601598.848863:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396160 00000100:00100000:1.0:1789601598.848913:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396288 00000100:00100000:1.0:1789601598.848917:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396288 00000100:00100000:1.0:1789601598.848939:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601598.848948:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918396160:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789601598.848979:0:9040:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789601598.849049:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918396160:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 100us (538us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601598.849058:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601598.849077:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789601598.849081:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918396288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789601598.849087:0:9040:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789601598.849111:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918396288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28us (454us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601598.849117:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789601598.849306:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601598.849313:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601598.849316:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918396160:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789601598.849324:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601598.849327:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601598.849330:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918396288:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1789601599.111828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601599.301906:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601599.301948:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601599.302058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601599.302540:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396416 00000100:00100000:2.0:1789601599.302551:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396416 00000100:00100000:2.0:1789601599.302633:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789601599.302644:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918396416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601599.302681:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789601599.302738:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918396416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601599.302746:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789601599.302957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918396416:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601600.133983:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601600.845510:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918396544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601600.845638:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601600.846207:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396544 00000100:00100000:2.0:1789601600.846222:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396544 00000100:00100000:2.0:1789601600.846315:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789601600.846327:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918396544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601600.846366:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789601600.846438:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918396544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601600.846446:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789601600.847720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918396544:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789601600.849273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1789601600.854615:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601600.854627:0:6500:0:(genops.c:885:class_export_put()) final put ffff8df501fcd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789601600.854733:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df501fcd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789601600.854810:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df501fcc800 for lustre-MDT0000 00010000:00010000:1.0:1789601601.158975:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789601601.797735:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c33c58a0 - data ffff8df3c1c545e8/ffff8df3c34a2800 00000020:01000000:2.0:1789601601.798129:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df4e153f3c0 - data ffff8df4c44bd798/ffff8df4c7b2d000 00000001:00000004:2.0:1789601601.809813:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789601601.937963:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789601601.937972:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789601601.938011:0:15056:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8df3c433dc00 x1876532918394112/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789601605 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601601.938035:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789601601.942874:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789601601.942882:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789601601.942977:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601601.942980:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789601601.948041:0:8854:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789601601.948065:0:8854:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789601601.948083:0:8854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789601601.949405:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789601601.949411:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789601601.949427:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601601.949430:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789601601.950188:0:9830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789601601.950192:0:9830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789601601.950206:0:9830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789601601.952434:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f109b 00000020:00000080:0.0:1789601601.952447:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc28000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789601601.958103:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f10b0 00000020:00000080:0.0:1789601601.958116:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc56000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789601601.959457:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc28000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789601601.959712:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789601601.959723:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601601.959732:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789601601.959737:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8df4d8093380) has no exports 00000004:01000000:0.0:1789601601.959913:0:15056:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789601601.959921:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f14e6 00000020:00000080:0.0:1789601601.959929:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df3c2b09000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789601601.963978:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789601601.964191:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601601.964208:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789601601.964213:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8df3c2100000) has no exports 00000020:00000080:0.0:1789601601.964249:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f14df 00000020:00000080:0.0:1789601601.964277:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df3c2aff800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789601601.965796:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc56000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789601601.965813:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b09000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789601601.966318:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2aff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789601601.968924:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789601601.968932:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789601601.968937:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789601601.968946:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601601.968948:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789601601.969685:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601601.969703:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601601.969713:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f13a4 00000020:00000080:0.0:1789601601.969722:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df3c23d9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789601601.970887:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2af8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789601601.970940:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df3c2b0b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789601601.970944:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b0b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789601601.970951:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789601601.971570:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789601601.971578:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601601.971592:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789601601.971598:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8df4f76399c0) has no exports 00000020:00000080:0.0:1789601601.971606:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f139d 00000020:00000080:0.0:1789601601.971615:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4f8da2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789601601.971656:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c23d9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1789601601.975167:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789601601.975317:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789601601.975321:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789601601.975329:0:15056:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601601.975333:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789601601.975516:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789601601.975989:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601601.976008:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f8da5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789601601.976015:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601601.976028:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df4f7395800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601601.976034:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7395800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000004:01000000:0.0:1789601601.976037:0:15056:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789601601.976048:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1269 00000020:01000000:2.0:1789601601.976051:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601601.976164:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4f7150800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789601601.976778:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789601601.976787:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601601.976817:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7150800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789601601.977125:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789601601.977131:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8df4f72699c0) has no exports 00000020:00000080:0.0:1789601601.977139:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1262 00000020:00000080:0.0:1789601601.977145:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4f7154000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789601601.977731:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7154000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789601601.988664:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789601601.988674:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789601601.988679:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789601601.988688:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789601601.988791:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601601.988805:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601601.988838:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601601.988842:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601601.988848:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789601601.988852:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc29800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789601601.988865:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601601.988974:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f10b7 00000020:00000080:0.0:1789601601.988981:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc51000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789601601.992089:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f7157000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789601601.992127:0:37:0:(genops.c:885:class_export_put()) final put ffff8df4f7154800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601601.992131:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7154800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789601601.992141:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789601601.993439:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789601601.993456:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601601.993760:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789601601.993766:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8df4d8090000) has no exports 00000020:00000080:2.0:1789601601.993979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc51000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789601601.994837:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601601.994848:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789601601.994854:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc29000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789601601.994857:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc29000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789601601.994866:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789601601.997149:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f10be 00000020:00000080:0.0:1789601601.997163:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc53000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789601601.997178:0:15056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4d017d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789601601.997181:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4d017d800 3 00000020:01000004:0.0:1789601601.997184:0:15056:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df4d017d800 from lustre-MDT0000 00000020:00000080:2.0:1789601601.997217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc53000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789601601.997278:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601601.997286:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789601601.997291:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ccc2f800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789601601.998303:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc2f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789601601.998336:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789601601.998408:0:15056:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789601601.998414:0:15056:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789601601.998418:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789601601.998422:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601601.998426:0:15056:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789601601.998432:0:15056:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8df4d9798800 9ae79c1b-f0a7-456b-b85e-4e644036ec22 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789601601.998438:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8df4f37219c0) has exports, disconnecting them 00000020:00080000:0.0:1789601601.998443:0:15056:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8df4d9798800), last request at 1789601331 00000020:00000080:0.0:1789601601.998459:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f105c 00000020:00010000:0.0:1789601601.998464:0:15056:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df4d9798800: total 0 00000100:00080000:0.0:1789601601.998469:0:15056:0:(import.c:65:import_set_state_nolock()) ffff8df4d016d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789601601.998484:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4d9798800): rc 0 00000020:00080000:0.0:1789601601.998489:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8df4f37219c0) has no exports 00000100:00100000:3.0:1789601601.998642:0:6515:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8df4e0c4c400:6515] 1 exiting: rc = 0 00000100:00100000:3.0:1789601601.998769:0:6514:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8df4e0c4d800:6514] 0 exiting: rc = 1 00000100:00100000:3.0:1789601601.998835:0:6516:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8df4d12ee800:6516] 2 exiting: rc = 0 00000020:00010000:2.0:1789601601.999536:0:6509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df4d9798800: total 0 00010000:00010000:2.0:1789601601.999621:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df4d9798800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789601601.999654:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f180b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1804 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999673:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679e00/0x74872e3eca9f1166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f115f expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999687:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7363800/0x74872e3eca9f17fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f17f6 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999714:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f155d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1556 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999724:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee000/0x74872e3eca9f156b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1564 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999733:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73efa00/0x74872e3eca9f1819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1812 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999746:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c0030800/0x74872e3eca9f147d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1476 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999759:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3467800/0x74872e3eca9f15cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f15c6 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999770:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ee400/0x74872e3eca9f1587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1580 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999780:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7362a00/0x74872e3eca9f1579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1572 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999799:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1528600/0x74872e3eca9f1158 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f1151 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999813:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f1595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f158e expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999823:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f15a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x74872e3eca9f159c expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601601.999847:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df4d9798800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789601601.999865:0:6509:0:(genops.c:885:class_export_put()) final put ffff8df4d9798800/9ae79c1b-f0a7-456b-b85e-4e644036ec22 00010000:00010000:2.0:1789601601.999889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601601.999891:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601601.999893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601601.999923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4d9798800/9ae79c1b-f0a7-456b-b85e-4e644036ec22 for MGS 00000020:00000080:3.0:1789601601.999986:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4d016d000 for MGS 00000100:00100000:0.0:1789601602.000005:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000017:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000022:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000028:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000036:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000045:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000053:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000062:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.000070:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001457:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001469:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001475:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001481:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001487:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001493:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001498:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001505:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001511:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001518:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001541:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001547:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001552:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001573:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001582:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001591:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001596:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001602:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001617:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001627:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001632:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001637:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001642:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001648:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001654:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001659:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001665:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001670:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001675:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001681:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001688:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001694:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001699:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001704:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001710:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001717:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001725:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001731:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001737:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001744:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001749:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001754:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001759:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001764:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001770:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001783:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001789:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001794:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001800:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001806:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001812:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001818:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001824:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001830:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601602.001836:0:15056:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789601602.005467:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c234d2a0 - data ffff8df4c4751ca8/ffff8df4f75e8000 00000020:01000000:0.0:1789601602.008404:0:15056:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df4d0aa1f00 - data ffff8df4c4466798/ffff8df4f394cc00 00000020:00000080:0.0:1789601602.015139:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1040 00000020:00000080:0.0:1789601602.015155:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4ebbff800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789601602.015226:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ebbff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789601602.015703:0:15056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4d017d800 from MGS, refs=2 00000020:01000004:0.0:1789601602.015710:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4d017d800 2 00000020:01000004:0.0:1789601602.015715:0:15056:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df4d017d800 from MGS 00000020:00000080:0.0:1789601602.015753:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601602.015763:0:15056:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789601602.015767:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4f37ca000/MGS 00000020:00000080:0.0:1789601602.015770:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f37ca000/MGS for MGS 00000020:01000000:0.0:1789601602.015780:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789601602.015871:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789601602.015878:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601602.015884:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789601602.015894:0:15056:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8df4cd0f7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789601602.015899:0:15056:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8df4f3724d40) has exports, disconnecting them 00000020:00080000:0.0:1789601602.015904:0:15056:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8df4cd0f7800), last request at 1789601332 00000020:00000080:0.0:1789601602.015909:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f110b 00000020:00080000:0.0:1789601602.015930:0:15056:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4cd0f7800): rc 0 00000020:00000080:0.0:1789601602.015936:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4cd0f7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789601602.017828:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0f7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789601602.022864:0:15056:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789601602.022876:0:15056:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789601602.022882:0:15056:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789601602.022891:0:15056:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789601602.023026:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4cd0f5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789601602.023238:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601602.023250:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789601602.023257:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4cd0f4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789601602.023262:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0f4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789601602.023270:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789601602.023376:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4d017d800 1 00000020:00000080:2.0:1789601602.023382:0:15056:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1032 00000020:00000080:2.0:1789601602.023391:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4f37c8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789601602.023408:0:15056:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789601602.023413:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601602.023419:0:15056:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789601602.023423:0:15056:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8df4d8094d40) has no exports 00000020:00000080:3.0:1789601602.023541:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f37c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789601602.085551:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601602.085622:0:15056:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789601602.085628:0:15056:0:(genops.c:885:class_export_put()) final put ffff8df4d0179800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789601602.085635:0:15056:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4d0179800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789601602.085642:0:15056:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789601602.085830:0:15056:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df4d017f000 00000020:02000400:2.0:1789601602.085895:0:15056:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789601602.181702:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601602.571492:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789601603.211675:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601603.912636:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601603.912644:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601603.912648:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601603.912656:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1789601603.912661:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789601603.912674:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df4f8da7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601603.912694:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c7480 x1876532918396800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601603.912787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918396800:0@lo:38:kworker.0 00000100:00100000:1.0:1789601603.912853:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601603.912958:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601603.912972:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918396672:0@lo:400:kworker.0 00000400:00000100:0.0:1789601603.913006:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876532918396672 offset 0 length 224: 4 00000100:00100000:2.0:1789601603.913024:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396800 00000100:00100000:2.0:1789601603.913033:0:7934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396800 00000100:00080000:3.0:1789601603.913065:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601603.913069:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601603.913070:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601603.913074:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1789601603.913076:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789601603.913080:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1789601603.913081:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df4f70a0000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601603.913087:0:7934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876532918396800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789601603.913106:0:7934:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789601603.913119:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6680 x1876532918396928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601603.917782:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918396928:0@lo:38:kworker.0 00000100:00100000:1.0:1789601603.919759:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601603.919888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918396928 00000100:00100000:0.0:1789601603.919898:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918396928 00000100:00100000:0.0:1789601603.919941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789601603.919948:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918396928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789601603.919969:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789601603.920023:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918396928:12345-0@lo:38:kworker.0 Request processed in 74us (270us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789601603.920029:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1789601603.920122:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601603.920127:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601603.920130:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601603.920134:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1789601603.920139:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789601603.920157:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df3c19cc800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601603.920821:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6a00 x1876532918397056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601603.920892:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601603.920896:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601603.920898:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601603.920902:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1789601603.920905:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789601603.920913:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df4f7392000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601603.920926:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6300 x1876532918397440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601603.921001:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918397312:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601603.921074:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601603.921080:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601603.921134:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397312 00000100:00100000:3.0:1789601603.921139:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397312 00000100:00100000:3.0:1789601603.921325:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789601603.921335:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918397312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921446:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918397312:12345-0@lo:400:kworker.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601603.921452:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789601603.921473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397568 00000100:00100000:3.0:1789601603.921477:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397568 00000100:00100000:3.0:1789601603.921601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789601603.921609:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921645:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918397568:12345-0@lo:400:kworker.0 Request processed in 38us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601603.921652:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:3.0:1789601603.921668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601603.921673:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601603.921768:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918397184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921797:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601603.921824:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601603.921830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918397696:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601603.921891:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397184 00000100:00100000:3.0:1789601603.921895:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397184 00000100:00100000:3.0:1789601603.921924:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789601603.921931:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918397184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.921965:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918397184:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601603.921971:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789601603.922004:0:8857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397696 00000100:00100000:3.0:1789601603.922008:0:8857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397696 00000100:00100000:3.0:1789601603.922034:0:8857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789601603.922041:0:8857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.922071:0:8857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918397696:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601603.922077:0:8857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1789601603.922093:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601603.922096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789601603.922118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df4d09c4a80 x1876532918397568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601603.922131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.922144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918397312:0@lo:400:kworker.0 00000100:00100000:3.0:1789601603.922190:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918397696:0@lo:400:kworker.0 00000100:00100000:2.0:1789601603.923464:0:7934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876532918396800:12345-0@lo:38:kworker.0 Request processed in 10371us (10607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789601603.923476:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00010000:00080000:3.0:1789601603.924651:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df4d09c7800 x1876532918397184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601603.924666:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918397184:0@lo:400:kworker.0 00000100:00080000:1.0:1789601603.925649:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601603.925658:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601603.925662:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918396800:0@lo:38:kworker.0 00000100:00100000:1.0:1789601603.925689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918397056:0@lo:38:kworker.0 00000100:00100000:1.0:1789601603.925743:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601603.925782:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918397440:0@lo:38:kworker.0 00000100:00100000:1.0:1789601603.925804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601603.926321:0:9040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397056 00000100:00100000:3.0:1789601603.926334:0:9040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397056 00000100:00100000:3.0:1789601603.926444:0:9040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789601603.926451:0:9040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918397056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789601603.926471:0:9040:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789601603.926600:0:9040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876532918397056:12345-0@lo:38:kworker.0 Request processed in 148us (856us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789601603.926607:0:9040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1789601603.926725:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601603.926730:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601603.926733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918396928:0@lo:38:kworker.0 00000100:00080000:1.0:1789601603.926754:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601603.926758:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601603.926761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918397056:0@lo:38:kworker.0 00000100:00100000:3.0:1789601603.926963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397440 00000100:00100000:3.0:1789601603.926968:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397440 00000100:00100000:3.0:1789601603.927009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789601603.927014:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918397440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789601603.927025:0:6521:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789601603.927058:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918397440:12345-0@lo:38:kworker.0 Request processed in 43us (1252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789601603.927064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1789601603.928581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601603.928590:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601603.928595:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918397440:0@lo:38:kworker.0 00010000:00010000:2.0:1789601604.240474:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601604.429820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918397824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601604.429891:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.429999:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397824 00000100:00100000:1.0:1789601604.430007:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397824 00000100:00100000:1.0:1789601604.430060:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789601604.430069:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918397824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601604.430096:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789601604.434893:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918397824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4815us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.434909:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789601604.435142:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918397824:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789601605.255057:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601605.957841:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601605.959051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918397952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601605.959124:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601605.965342:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918397952 00000100:00100000:3.0:1789601605.965358:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918397952 00000100:00080000:2.0:1789601605.965510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601605.965581:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789601605.965592:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918397952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789601605.965622:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789601605.965716:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918397952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (6592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601605.965723:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789601605.965806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918397952:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789601606.279436:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789601606.382675:0:15257:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789601606.421197:0:15257:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789601606.421258:0:15257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.421289:0:15257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.421296:0:15257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.421303:0:15257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.421325:0:15257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789601606.421331:0:15257:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789601606.421357:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601606.421361:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789601606.421367:0:15257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789601606.421373:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789601606.421378:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601606.421379:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789601606.421382:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789601606.423775:0:15257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423792:0:15257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423799:0:15257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423807:0:15257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423844:0:15257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789601606.423850:0:15257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423856:0:15257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423863:0:15257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423868:0:15257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423883:0:15257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789601606.423890:0:15257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423896:0:15257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423903:0:15257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423909:0:15257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423915:0:15257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789601606.423920:0:15257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423930:0:15257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423937:0:15257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423943:0:15257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601606.423949:0:15257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789601606.423952:0:15257:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789601606.424069:0:15257:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789601606.424073:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789601606.424076:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.424082:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789601606.424089:0:15257:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8df4ccc2d000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601606.424095:0:15257:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8df4f70a2800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601606.424100:0:15257:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8df4f8d94d40) has exports, disconnecting them 00000020:00080000:3.0:1789601606.424105:0:15257:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df4ccc2d000), last request at 1789601603 00000020:00000080:3.0:1789601606.424111:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f143e 00000100:00080000:3.0:1789601606.424128:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df4ccc2e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789601606.424179:0:15257:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4ccc2d000): rc 0 00000020:00000080:3.0:1789601606.424181:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4ccc2d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789601606.424192:0:15257:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df4f70a2800), last request at 1789601603 00000020:00000080:3.0:1789601606.424195:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1318 00000100:00080000:3.0:1789601606.424200:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df3c2393000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789601606.424209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc2d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789601606.424258:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4ccc2e000 for lustre-MDT0001 00000020:00080000:3.0:1789601606.424269:0:15257:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4f70a2800): rc 0 00000020:00000080:3.0:1789601606.424271:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f70a2800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789601606.424279:0:15257:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa27c81507ae0 00000020:00000080:3.0:1789601606.424288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f70a2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789601606.424305:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2393000 for lustre-MDT0001 00000100:00080000:3.0:1789601606.424321:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601606.424330:0:15257:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8df4d09c5880 x1876532918394624/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789601613 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.424344:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789601606.425976:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789601606.425989:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426001:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601606.426005:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426015:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601606.426022:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601606.426048:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601606.426051:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789601606.426055:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789601606.426096:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426103:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601606.426135:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426257:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f158e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426271:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789601606.426275:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426280:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601606.426283:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426289:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601606.426295:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601606.426299:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601606.426301:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789601606.426303:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789601606.426320:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426325:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601606.426337:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426343:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7363200/0x74872e3eca9f159c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f15a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426351:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789601606.426354:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426359:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601606.426361:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426368:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601606.426374:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601606.426379:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601606.426381:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789601606.426382:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789601606.426392:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426397:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601606.426403:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426415:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362400/0x74872e3eca9f1476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f147d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426427:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601606.426430:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426436:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601606.426439:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426445:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601606.426452:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601606.426457:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789601606.426459:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789601606.426461:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789601606.426474:0:7464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.426479:0:7464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601606.426603:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601606.426609:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601606.426616:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601606.426619:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601606.426626:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601606.426633:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601606.426639:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601606.426647:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789601606.426649:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789601606.426664:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601606.426670:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601606.426676:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601606.426682:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f115f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1166 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601606.426695:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601606.426697:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601606.426698:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601606.426715:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601606.426779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601606.426828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601606.426850:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601606.426874:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601606.426880:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601606.426901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601606.426927:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918398208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601606.426966:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601606.426985:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601606.426991:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918398336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601606.427012:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601606.427103:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398080 00000100:00100000:2.0:1789601606.427117:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398080 00000100:00100000:2.0:1789601606.427156:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398592 00000100:00100000:2.0:1789601606.427159:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398592 00000100:00100000:2.0:1789601606.427168:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398464 00000100:00100000:2.0:1789601606.427170:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398464 00000100:00100000:2.0:1789601606.427176:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398208 00000100:00100000:2.0:1789601606.427178:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398208 00000100:00100000:2.0:1789601606.427186:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398336 00000100:00100000:2.0:1789601606.427187:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398336 00000100:00100000:2.0:1789601606.427210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601606.427218:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876532918398080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789601606.427224:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601606 with bad export cookie 8396730877477851228 00010000:00010000:0.0:1789601606.428646:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.428661:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef400/0x74872e3eca9f1812 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x74872e3eca9f1819 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601606.428697:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601606.428699:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601606.428702:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601606.429371:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918394624:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789601606.429399:0:15257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789601606.429405:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df4f8da7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789601606.429681:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789601606.429685:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789601606.429699:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789601606.429754:0:15257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789601606.429774:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df4f7391000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789601606.429791:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789601606.429793:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789601606.429800:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789601606.429855:0:15257:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789601606.429865:0:15257:0:(import.c:65:import_set_state_nolock()) ffff8df4f7345800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789601606.429888:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8df4f8d94d40) has no exports 00010000:00010000:1.0:1789601606.430742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601606.430777:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601606.430786:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d8015450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1876532918398592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789601606.430809:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601606 with bad export cookie 8396730877477851228 00000100:00100000:1.0:1789601606.430889:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d8015450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1876532918398592:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (4037us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601606.430898:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601606.430924:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601606.430928:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1876532918398464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789601606.430932:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601606 with bad export cookie 8396730877477851228 00000100:00100000:1.0:1789601606.430957:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1876532918398464:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (4055us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601606.430977:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601606.430989:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601606.430993:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876532918398208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789601606.430997:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601606 with bad export cookie 8396730877477851228 00000100:00100000:1.0:1789601606.431032:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876532918398208:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (4083us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601606.431038:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601606.431050:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601606.431055:0:7465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876532918398336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789601606.431059:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601606 with bad export cookie 8396730877477851228 00000100:00100000:1.0:1789601606.431081:0:7465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876532918398336:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (4069us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601606.431087:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601606.431110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918398720:0@lo:9:umount.0 00000100:00100000:1.0:1789601606.431156:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601606.431185:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918398848:0@lo:9:umount.0 00000100:00100000:1.0:1789601606.434978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601606.435048:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398720 00000100:00100000:1.0:1789601606.435057:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398720 00000100:00100000:1.0:1789601606.435111:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918398848 00000100:00100000:1.0:1789601606.435115:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918398848 00000100:00100000:1.0:1789601606.435138:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601606.435146:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876532918398720:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789601606.435175:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1365 00000100:00080000:1.0:1789601606.435185:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8df3c23dc000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789601606.436874:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789601606.436889:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876532918398848:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789601606.436912:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f14b5 00000100:00080000:0.0:1789601606.436921:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8df3c298e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789601606.437017:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789601606.437182:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876532918398720:12345-0@lo:9:umount.0 Request processed in 2036us (6036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601606.437190:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789601606.437325:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7391000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789601606.437333:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789601606.437335:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789601606.437339:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918398720:0@lo:9:umount.0 00000001:00000004:0.0:1789601606.438113:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:1.0:1789601606.438307:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601606.439369:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1876532918398848:12345-0@lo:9:umount.0 Request processed in 2480us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601606.439378:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789601606.441847:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f7345800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789601606.441860:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789601606.441862:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789601606.441869:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918398848:0@lo:9:umount.0 00000100:00080000:0.0:1789601606.447731:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601606.451615:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601606.451665:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789601606.451670:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789601606.451692:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789601606.451709:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.148@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789601606.451711:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789601606.451719:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df4d09c4000 x1876532918396672/t0(0) o400->MGC192.168.203.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789601619 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.451738:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4067800 x1876532918398080/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601622 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.451747:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df4ff500000 x1876532918398592/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601622 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.451754:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4064700 x1876532918398464/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601622 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.451762:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4065f80 x1876532918398208/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601622 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601606.451769:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4066a00 x1876532918398336/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601622 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789601606.451777:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789601606.451780:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789601606.451781:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789601606.451784:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601606.451788:0:3645:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1789601606.451801:0:3645:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8df4f37cf800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601606.451828:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6300 x1876532918398976/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601606.451852:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918398208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601606.451875:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3645:1876532918398336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601606.451934:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918398976:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789601606.451986:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876532918398976 offset 0 length 520: 4 00000100:00100000:1.0:1789601606.452035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3646:1876532918396672:0@lo:400:kworker.0 00000100:00100000:3.0:1789601606.454743:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601606.454775:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601606.454782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4ff500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3648:1876532918398592:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789601606.488353:0:6506:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876532918398080 offset 224 length 224: 4 00000100:00100000:3.0:1789601606.488387:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4ff501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876532918398080:12345-0@lo:103:ldlm_bl.0 Request processed in 61167us (61606us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789601606.488402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:0.0:1789601606.493833:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8df4f8d94d40) has no exports 00000020:01000000:1.0:1789601606.540444:0:15257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c234da80 - data ffff8df4c4751000/ffff8df4f722bc00 00000020:01000000:1.0:1789601606.540788:0:15257:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df4f8b16000 - data ffff8df4c45aea20/ffff8df4f8cfac00 00000001:00000004:1.0:1789601606.577847:0:15257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789601606.638845:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601606.638856:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789601606.638865:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789601606.643587:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789601606.643597:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789601606.643616:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601606.643619:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789601606.644388:0:8847:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789601606.644395:0:8847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789601606.644420:0:8847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789601606.645515:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789601606.645523:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1789601606.645545:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789601606.645548:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789601606.646511:0:9826:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789601606.646518:0:9826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789601606.646530:0:9826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789601606.654692:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1182 00000020:00000080:3.0:1789601606.654711:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4c7b52000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789601606.655370:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4c7b52000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789601606.662355:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1197 00000020:00000080:3.0:1789601606.662374:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8da2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789601606.662437:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789601606.662444:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.662455:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789601606.662460:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8df4f8d90000) has no exports 00000004:01000000:3.0:1789601606.662969:0:15257:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789601606.662981:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f14a0 00000020:00000080:3.0:1789601606.662988:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df3c2b0a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601606.666940:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789601606.668435:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789601606.668701:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b0a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789601606.669130:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.669148:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789601606.669154:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8df4f726cd40) has no exports 00000020:00000080:3.0:1789601606.669166:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1499 00000020:00000080:3.0:1789601606.669176:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df3c2afa800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789601606.670018:0:15257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789601606.670025:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789601606.670046:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789601606.670055:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789601606.670058:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789601606.670097:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601606.670109:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789601606.670118:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f135e 00000020:00000080:3.0:1789601606.670127:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f7393800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789601606.670134:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789601606.670138:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.670142:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789601606.670145:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8df4f763b380) has no exports 00000020:00000080:3.0:1789601606.670150:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1357 00000020:00000080:3.0:1789601606.670154:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f7397000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789601606.670370:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2afa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789601606.670382:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f7345800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789601606.670390:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df3c2af8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601606.670392:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2af8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789601606.670398:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601606.670517:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7393800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789601606.670522:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7397000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789601606.671240:0:15257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789601606.671247:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789601606.671251:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789601606.671257:0:15257:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789601606.671260:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789601606.671907:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601606.671923:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789601606.671943:0:15257:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789601606.671951:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f11ba 00000020:00000080:3.0:1789601606.671969:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8da5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789601606.671978:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789601606.671986:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.671991:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789601606.671994:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8df4f8d919c0) has no exports 00000020:00000080:3.0:1789601606.672001:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f11b3 00000020:00000080:3.0:1789601606.672004:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8da0000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789601606.672356:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f7391000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789601606.672365:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df4ccc2a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601606.672368:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc2a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789601606.672374:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601606.672496:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789601606.672501:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789601606.675033:0:15257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789601606.675045:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789601606.675051:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789601606.675063:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789601606.675149:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601606.675163:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601606.675210:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601606.675217:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601606.675225:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4cd0f6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601606.675233:0:15257:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0f6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789601606.675243:0:15257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601606.675506:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f119e 00000020:00000080:2.0:1789601606.675518:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8da1800/lustre-MDD0001_UUID 00000020:01000000:2.0:1789601606.675528:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789601606.675535:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601606.675542:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789601606.675547:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8df4f8d93380) has no exports 00000020:00000080:2.0:1789601606.675615:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601606.675621:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789601606.675627:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f11a5 00000020:00000080:2.0:1789601606.675633:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8da0800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789601606.675644:0:15257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4f8b56000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789601606.675648:0:15257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f8b56000 2 00000020:01000004:2.0:1789601606.675652:0:15257:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df4f8b56000 from lustre-MDT0001 00000020:00000080:2.0:1789601606.675702:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601606.675709:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789601606.675712:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4c7b51800/lustre-MDT0001_UUID 00000020:00000080:2.0:1789601606.675715:0:15257:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4c7b51800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789601606.675723:0:15257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:0.0:1789601606.675923:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f8da7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789601606.675934:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df4f8da4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789601606.675937:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789601606.675950:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000004:2.0:1789601606.677483:0:15257:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789601606.677496:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789601606.677501:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601606.677511:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789601606.677521:0:15257:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8df4f70a5000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789601606.677530:0:15257:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8df4f3723380) has exports, disconnecting them 00000020:00080000:2.0:1789601606.677537:0:15257:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8df4f70a5000), last request at 1789601351 00000020:00000080:2.0:1789601606.677542:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f11f9 00000020:00080000:2.0:1789601606.677602:0:15257:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4f70a5000): rc 0 00000020:00000080:2.0:1789601606.677608:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f70a5000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789601606.678033:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789601606.678048:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df4f8da4000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789601606.678051:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da4000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789601606.678057:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789601606.678247:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8da0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789601606.678253:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f70a5000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789601606.723664:0:15257:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789601606.723684:0:15257:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601606.723690:0:15257:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789601606.723700:0:15257:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789601606.723735:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f70a0000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789601606.723970:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601606.723991:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789601606.723998:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df501e67800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789601606.724003:0:15257:0:(genops.c:844:class_export_destroy()) destroying export ffff8df501e67800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789601606.724016:0:15257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789601606.724100:0:15257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f8b56000 1 00000020:00000080:0.0:1789601606.724108:0:15257:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1135 00000020:00000080:0.0:1789601606.724116:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4ccc57000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789601606.724125:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789601606.724133:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4ccc57000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789601606.724142:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601606.724148:0:15257:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789601606.724152:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8df4d09cb380) has no exports 00000020:00000080:3.0:1789601606.851415:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601606.851431:0:15257:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789601606.851438:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4f8b56800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789601606.851454:0:15257:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f8b56800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789601606.851467:0:15257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789601606.851627:0:15257:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df4f8b55000 00000020:01000000:3.0:1789601606.851652:0:15257:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789601606.851656:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601606.851661:0:15257:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789601606.851666:0:15257:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8df4d09c8000) has no exports 00000100:00100000:3.0:1789601606.851773:0:9040:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8df3c20f9000:9040] 3 exiting: rc = 0 00000100:00100000:3.0:1789601606.851903:0:6522:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8df4c4345200:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1789601606.851994:0:6521:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8df4c4344200:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1789601606.852200:0:6523:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8df4d8024600:6523] 2 exiting: rc = 0 00000100:00100000:1.0:1789601606.852268:0:14968:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8df3c345c200:14968] 4 exiting: rc = 0 00000100:00100000:3.0:1789601606.854864:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854878:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854884:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854890:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854897:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854902:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854908:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854914:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854919:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854924:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854930:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854935:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854941:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854946:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.854952:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855143:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855151:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855157:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855163:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855168:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855186:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855194:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855200:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855207:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855227:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855234:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855240:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855246:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855253:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855258:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855265:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855272:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855278:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855284:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855290:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855296:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855303:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855308:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855313:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855320:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855326:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855333:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855338:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855345:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855350:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855356:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855363:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855369:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855375:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855381:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855386:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855393:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855399:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855404:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855411:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855418:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855424:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855430:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855435:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855450:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855455:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855463:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855468:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.855481:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601606.861820:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8df4d8027600:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1789601606.862552:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8df4d8025e00:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1789601606.867459:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867472:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867478:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867485:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867491:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867497:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867503:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867510:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867516:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867522:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867527:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867533:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867540:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867545:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867551:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867886:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867894:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867899:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867906:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867912:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867918:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867924:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867930:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867935:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867940:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867945:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867950:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867965:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867972:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867978:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.867997:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868003:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868008:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868014:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868020:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868025:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868030:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868035:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868041:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868047:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868053:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868059:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868073:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868086:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868092:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868098:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868104:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868108:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868113:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868119:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868124:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868130:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868136:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868142:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868147:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868153:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868158:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868164:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868173:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868179:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868185:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868191:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868197:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.868203:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.874664:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8df4e01db600:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1789601606.875201:0:7934:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8df4f8d61c00:7934] 2 exiting: rc = 0 00000100:00100000:1.0:1789601606.875434:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8df4d8027400:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1789601606.875586:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875598:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875627:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875633:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875640:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875646:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875653:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875661:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875667:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875684:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875692:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875699:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875740:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875748:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875771:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875779:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875786:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875793:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875800:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875806:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875813:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875820:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875830:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875846:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875854:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875862:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875887:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875896:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875903:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875911:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875918:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875924:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875932:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875939:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875945:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875952:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875969:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.875976:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876000:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876009:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876016:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876023:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876030:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876037:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876043:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876050:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876057:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876075:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876295:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876304:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876326:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876334:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876341:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876349:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876357:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876364:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876372:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876378:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876393:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876399:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876406:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876412:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876418:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.876425:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601606.907046:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8df4d12e2800:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1789601606.907366:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8df4d12e2000:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1789601606.907638:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.907651:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.907660:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908473:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908491:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908514:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908521:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908526:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908532:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908537:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908543:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908548:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908579:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908587:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908593:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908599:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908605:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908611:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908617:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908622:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908627:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908632:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908638:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908643:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908648:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908654:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908659:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908664:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908669:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908688:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908694:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908700:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908705:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908710:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908717:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908722:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908726:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908731:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908736:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908741:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908754:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908760:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908767:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908773:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908778:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908784:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908790:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908795:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908800:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908805:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908810:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908816:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908820:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908826:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908832:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908838:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908843:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908848:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908853:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908859:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908864:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908869:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908874:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601606.908880:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.914214:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8df4f5ef3c00:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1789601606.914853:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8df4d12e1800:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1789601606.915309:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915319:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915325:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915330:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915337:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915342:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915348:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915355:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915360:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915365:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915370:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915378:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915385:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915393:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915401:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915409:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915416:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915425:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915433:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915441:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915448:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915455:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915462:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915468:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915473:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915479:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915484:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915489:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915495:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915500:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915505:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915511:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915519:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915527:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915535:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915812:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915819:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915825:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915832:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915839:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915846:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915853:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915859:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915865:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915871:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915878:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915885:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915891:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915897:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915903:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915910:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.915916:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916228:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916233:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916239:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916244:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916250:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916255:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916260:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916266:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916270:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916276:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916281:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.916286:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.917368:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8df4d9868c00:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1789601606.918327:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8df4f5ef2c00:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1789601606.918581:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918592:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918598:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918603:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918608:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918613:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918619:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918625:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918630:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918636:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918641:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918647:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918652:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918657:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918662:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918666:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918671:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918687:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918693:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918699:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918704:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918709:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918715:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918720:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918726:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918731:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918737:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918757:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918762:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918767:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918773:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918778:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918782:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918787:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918792:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918797:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918803:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918808:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918815:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918824:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918833:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918841:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918849:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918874:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918884:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918892:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918901:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918909:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918917:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918930:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918939:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918948:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918967:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918978:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918988:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.918997:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919005:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919012:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919018:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919024:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919029:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919034:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919047:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601606.919052:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.922541:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8df4d9866a00:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1789601606.923017:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8df4d9868600:6536] 2 exiting: rc = 0 00000100:00100000:2.0:1789601606.923897:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8df4ebaaf000:6535] 1 exiting: rc = 0 00000100:00100000:3.0:1789601606.925038:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925051:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925060:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925122:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925130:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925150:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925160:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925166:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925173:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925180:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925187:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925193:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925200:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925208:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925235:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925242:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925248:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925254:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925260:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925266:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925272:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925278:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925285:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925291:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925296:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925303:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925310:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925316:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925322:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925328:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925336:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925343:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925349:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925355:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925361:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925370:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925376:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925384:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925413:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925421:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925426:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925433:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925440:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925446:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925453:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925459:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925466:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925473:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925479:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925485:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925491:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925498:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925503:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925511:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925518:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925524:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925531:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925536:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925542:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925548:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925594:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925601:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925609:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601606.925623:0:15257:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789601606.936359:0:15257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601606.936377:0:15257:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789601606.936385:0:15257:0:(genops.c:885:class_export_put()) final put ffff8df4d09d2800/MDS_uuid 00000020:00000080:0.0:1789601606.936391:0:15257:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4d09d2800/MDS_uuid for MDS 00000020:01000000:0.0:1789601606.936404:0:15257:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789601606.936597:0:15257:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789601607.315814:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601608.369877:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789601609.030134:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601609.030147:0:1385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789601609.030151:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601609.030155:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789601609.030160:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601609.030170:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1789601609.030177:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789601609.030192:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df3c19cc800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601609.030239:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36af800 x1876532918399104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601609.030314:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918399104:0@lo:38:kworker.0 00000400:00000100:1.0:1789601609.030378:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399104 offset 0 length 520: 4 00000100:00080000:2.0:1789601609.030593:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601609.030598:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789601609.030600:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601609.030604:0:1385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1789601609.030611:0:1385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789601609.030617:0:1385:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df4f7392000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601609.030631:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36aed80 x1876532918399360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601609.030677:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601609.030693:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918399232:0@lo:400:kworker.0 00000400:00000100:0.0:1789601609.030720:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399232 offset 0 length 224: 4 00000100:00100000:1.0:1789601609.031289:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918399360:0@lo:38:kworker.0 00000400:00000100:1.0:1789601609.031316:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399360 offset 0 length 520: 4 00000100:00100000:1.0:1789601609.034632:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918399488:0@lo:400:kworker.0 00000400:00000100:1.0:1789601609.034696:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399488 offset 0 length 224: 4 00010000:00010000:3.0:1789601609.349749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601610.373742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601611.078686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789601611.078736:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601611.078740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789601611.078743:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601611.079253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789601611.079257:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789601611.079344:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918399744:0@lo:400:kworker.0 00000400:00000100:2.0:1789601611.079409:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399744 offset 0 length 224: 4 00000100:00100000:2.0:1789601611.079487:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601611.079494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918399616:0@lo:400:kworker.0 00000400:00000100:2.0:1789601611.079524:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399616 offset 0 length 224: 4 00010000:00010000:0.0:1789601611.403729:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789601611.596920:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789601611.597004:0:9518:0:(genops.c:885:class_export_put()) final put ffff8df3c298f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789601611.598225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c298f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000001:00100000:3.0:1789601611.602416:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789601611.602428:0:8434:0:(genops.c:885:class_export_put()) final put ffff8df3c23db000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789601611.614750:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c298e000 for lustre-OST0001 00000020:00000080:1.0:1789601611.614853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c23db000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789601611.614911:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c23dc000 for lustre-OST0000 00000020:01000004:0.0:1789601611.745962:0:15458:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789601611.763893:0:15458:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789601611.763979:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601611.763997:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601611.764006:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601611.764014:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601611.764040:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601611.764047:0:15458:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789601611.764077:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601611.764093:0:15458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36af800 x1876532918399104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601611.764111:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789601611.764134:0:15458:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789601611.764142:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789601611.764148:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601611.764152:0:15458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36af800 x1876532918399104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601629 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601611.764160:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789601611.764163:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:3.0:1789601611.764258:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601611.764267:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601611.764277:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601611.764286:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601611.764296:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601611.764304:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601611.764310:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601611.764312:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789601611.764315:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789601611.764330:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:3.0:1789601611.764334:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601611.764342:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383400/0x74872e3eca9f1572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f1579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601611.764353:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601611.764355:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601611.764356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601611.764718:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918399104:0@lo:38:kworker.0 00000100:00080000:0.0:1789601611.766464:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789601611.766482:0:15458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36ac000 x1876532918399232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601611.766549:0:15458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4065500 x1876532918399616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601611.766594:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789601611.766601:0:15458:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789601611.766635:0:15458:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789601611.766730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918399616:0@lo:400:kworker.0 00000100:00100000:3.0:1789601611.766915:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918399872:0@lo:39:umount.0 00000400:00000100:3.0:1789601611.766986:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918399872 offset 0 length 224: 4 00000100:00100000:1.0:1789601611.769350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918399232:0@lo:400:kworker.0 00010000:00010000:1.0:1789601612.422001:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601613.446289:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601614.087544:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601614.087588:0:1385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601614.087592:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601614.087596:0:1385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789601614.087804:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601614.087829:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918400000:0@lo:400:kworker.0 00000400:00000100:1.0:1789601614.087916:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918400000 offset 0 length 224: 4 00010000:00010000:3.0:1789601614.469730:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601615.493822:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601616.517793:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601616.901697:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601606/real 1789601606] req@ffff8df4d09c6300 x1876532918398976/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789601616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601616.901740:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df4d09c6300 x1876532918398976/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789601616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789601616.901775:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601616.901811:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789601616.901815:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918398976:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1789601616.902064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601616.902070:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789601616.902074:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601616.902079:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789601616.902086:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789601616.902098:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8df4f37cf800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601616.902143:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ac380 x1876532918400128/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601616.902255:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918400128:0@lo:250:kworker.0 00000400:00000100:1.0:1789601616.902313:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876532918400128 offset 0 length 520: 4 00000100:00080000:2.0:1789601616.902394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601616.902400:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789601616.902552:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918400256:0@lo:400:kworker.0 00000400:00000100:0.0:1789601616.902607:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918400256 offset 0 length 224: 4 00010000:00010000:3.0:1789601617.541742:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601618.565845:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601619.590055:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601620.613769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601621.637902:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601622.021705:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601611/real 1789601611] req@ffff8df3c4065880 x1876532918399872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789601621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601622.021749:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c4065880 x1876532918399872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789601621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789601622.021773:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c19cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789601622.021797:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918399872:0@lo:39:umount.0 00000100:00080000:0.0:1789601622.021907:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789601622.021914:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789601622.021920:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789601622.023017:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023056:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023080:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023089:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023118:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601622.023127:0:15458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023134:0:15458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023141:0:15458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023148:0:15458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601622.023169:0:15458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789601622.023173:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1789601622.023175:0:15458:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1789601622.023184:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023195:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383800 already unused, calling callback (ffffffffc1529c20) 00000020:01000004:0.0:1789601622.023206:0:15458:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789601622.023212:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:1.0:1789601622.023213:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789601622.023218:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601622.023225:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1789601622.023227:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789601622.023231:0:15458:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8df4d09c99c0) has no exports 10000000:00010000:1.0:1789601622.023239:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601622.023246:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789601622.023249:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789601622.023252:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:0.0:1789601622.023265:0:15458:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8df4d09c99c0) has no exports 00010000:00010000:1.0:1789601622.023271:0:7464:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:1.0:1789601622.023276:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023284:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7383800/0x74872e3eca9f1580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f1587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023301:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601622.023305:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023310:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7362600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601622.023314:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023319:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601622.023325:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601622.023340:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789601622.023343:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789601622.023345:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789601622.023351:0:7464:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:1.0:1789601622.023355:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023362:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362600/0x74872e3eca9f1804 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f180b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601622.023371:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601622.023373:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601622.023375:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601622.025146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789601622.026856:0:15458:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c234d840 - data ffff8df3c1c01360/ffff8df4f7228400 00000020:01000000:0.0:1789601622.027066:0:15458:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c2162960 - data ffff8df4c4490360/ffff8df4f8c2e400 00100000:10000000:0.0:1789601622.038382:0:15458:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789601622.055535:0:15458:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f12d2 00000020:00000080:3.0:1789601622.055550:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df3c19cf800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789601622.055578:0:15458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4f70a3000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789601622.055583:0:15458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f70a3000 2 00000020:01000004:3.0:1789601622.055586:0:15458:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df4f70a3000 from lustre-OST0000 00000020:00000080:3.0:1789601622.055619:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601622.055631:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789601622.055635:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df3c19ca800/lustre-OST0000_UUID 00000020:00000080:3.0:1789601622.055638:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c19ca800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789601622.055647:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789601622.055714:0:15458:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789601622.055720:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789601622.055724:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601622.055729:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789601622.055737:0:15458:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8df4f72d1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601622.055744:0:15458:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8df3c2104d40) has exports, disconnecting them 00000020:00080000:3.0:1789601622.055749:0:15458:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8df4f72d1800), last request at 1789601371 00000020:00000080:3.0:1789601622.055754:0:15458:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f12fc 00000020:00080000:3.0:1789601622.055763:0:15458:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df4f72d1800): rc 0 00000020:00000080:3.0:1789601622.055768:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df4f72d1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789601622.056660:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c19cf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789601622.056682:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f72d1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789601622.059529:0:15458:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789601622.059541:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601622.059546:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789601622.059572:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789601622.059794:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601622.059806:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789601622.059827:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789601622.059832:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601622.059837:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789601622.059856:0:15458:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8df501e67000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601622.059864:0:15458:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8df4f7354d40) has exports, disconnecting them 00000020:00080000:3.0:1789601622.059869:0:15458:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8df501e67000), last request at 1789601371 00000020:00000080:3.0:1789601622.059874:0:15458:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1311 00000020:00080000:3.0:1789601622.059890:0:15458:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df501e67000): rc 0 00000020:00000080:3.0:1789601622.059894:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df501e67000/lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789601622.071133:0:15458:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789601622.071144:0:15458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789601622.071148:0:15458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789601622.071155:0:15458:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789601622.071333:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601622.071341:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789601622.071348:0:15458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4f70a3000 1 00000020:00000080:1.0:1789601622.071355:0:15458:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f129a 00000020:00000080:1.0:1789601622.071364:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df4cd0de000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789601622.071368:0:15458:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789601622.071375:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601622.071379:0:15458:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789601622.071383:0:15458:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8df4f7350000) has no exports 00000020:00000080:1.0:1789601622.078653:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c19cc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789601622.078671:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df3c19c8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789601622.078675:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c19c8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789601622.078719:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789601622.078777:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df501e67000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789601622.078784:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c19cb000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789601622.078790:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df501e61000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789601622.078792:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df501e61000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789601622.078795:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789601622.078813:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0de000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789601622.217365:0:15458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601622.217385:0:15458:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789601622.217393:0:15458:0:(genops.c:885:class_export_put()) final put ffff8df4f70a3800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789601622.217399:0:15458:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f70a3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789601622.217412:0:15458:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789601622.217648:0:15458:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df4f70a5800 00000020:02000400:1.0:1789601622.217711:0:15458:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1789601622.346672:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789601622.346697:0:1385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601622.346700:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789601622.346703:0:1385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789601622.346785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601622.346803:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918400384:0@lo:400:kworker.0 00000400:00000100:1.0:1789601622.346882:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918400384 offset 0 length 224: 4 00010000:00010000:1.0:1789601622.665732:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601623.685794:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601624.710014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789601625.029760:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601609/real 1789601609] req@ffff8df3c36adc00 x1876532918399488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789601625 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601625.093534:0:3646:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8df3c36adc00 x1876532918399488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789601625 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601625.093553:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789601625.093581:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789601625.106459:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1789601625.106518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918399488:0@lo:400:kworker.0 00000100:00080000:2.0:1789601625.110219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601625.110240:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789601625.110244:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601625.110248:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789601625.110251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789601625.110255:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789601625.110259:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601625.110267:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 262 00000100:00080000:2.0:1789601625.110299:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601625.110339:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36af100 x1876532918400512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601625.110983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918400512:0@lo:38:kworker.0 00000400:00000100:1.0:1789601625.111036:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532918400512 offset 0 length 520: 4 00010000:00010000:0.0:1789601625.734796:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789601626.409777:0:15660:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789601626.431153:0:15660:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789601626.431238:0:15660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.431253:0:15660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.431261:0:15660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.431268:0:15660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.431331:0:15660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789601626.431337:0:15660:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789601626.431358:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789601626.431370:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36aed80 x1876532918399360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.431394:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789601626.431401:0:15660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789601626.431406:0:15660:0:(import.c:65:import_set_state_nolock()) ffff8df4f7392000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789601626.431410:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789601626.431415:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36aed80 x1876532918399360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601629 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.431421:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789601626.431424:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1789601626.434159:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918399360:0@lo:38:kworker.0 00000100:00080000:2.0:1789601626.435056:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789601626.435068:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4066300 x1876532918399744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435090:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df4d09c7b80 x1876532918400000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435112:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36afb80 x1876532918400256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435121:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c359f480 x1876532918400384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601638 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435129:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36af100 x1876532918400512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601635 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435139:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789601626.435145:0:15660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789601626.435150:0:15660:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789601626.435155:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789601626.435158:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c4066300 x1876532918399744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601627 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435164:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df4d09c7b80 x1876532918400000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601630 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435170:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36afb80 x1876532918400256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601632 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435176:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c359f480 x1876532918400384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601638 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435183:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36af100 x1876532918400512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601635 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601626.435189:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789601626.435191:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1789601626.435295:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918400384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601626.435311:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918399744:0@lo:400:kworker.0 00000100:00100000:3.0:1789601626.435365:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918400512:0@lo:38:kworker.0 00000100:00100000:1.0:1789601626.435742:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918400256:0@lo:400:kworker.0 00000100:00100000:1.0:1789601626.435765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876532918400000:0@lo:400:kworker.0 00010000:00010000:2.0:1789601626.436692:0:15660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436708:0:15660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436716:0:15660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436723:0:15660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.436926:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601626.436941:0:15660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601626.436950:0:15660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436957:0:15660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436964:0:15660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.436969:0:15660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438423:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601626.438436:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438446:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7363400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601626.438451:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438461:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601626.438469:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601626.438493:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601626.438496:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1789601626.438510:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:3.0:1789601626.438515:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438522:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7363400/0x74872e3eca9f1564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438540:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601626.438545:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438551:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466200 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601626.438567:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438575:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601626.438582:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601626.438587:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789601626.438590:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789601626.438593:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:3.0:1789601626.438596:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.438614:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601626.438616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601626.438618:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601626.442639:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.442658:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382a00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601626.442663:0:7464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.442674:0:7464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601626.442681:0:7464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601626.442688:0:7464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789601626.442690:0:7464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789601626.442693:0:7464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789601626.442729:0:7464:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:0.0:1789601626.442734:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.442741:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382a00/0x74872e3eca9f1556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.442826:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601626.442829:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601626.442832:0:7464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601626.443479:0:15660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789601626.443488:0:15660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3466200/0x74872e3eca9f17f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f17fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601626.443507:0:15660:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789601626.443522:0:15660:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789601626.443525:0:15660:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789601626.443578:0:15660:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789601626.443583:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1789601626.443740:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601626.443765:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601626.443774:0:15660:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789601626.443779:0:15660:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8df3c2103380) has no exports 00000020:00080000:3.0:1789601626.444249:0:15660:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8df3c2103380) has no exports 00000020:01000000:3.0:1789601626.448534:0:15660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df3c33c5c00 - data ffff8df4c4753798/ffff8df3c34a1800 00000020:01000000:2.0:1789601626.448742:0:15660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df4c4384600 - data ffff8df3c1cd1d80/ffff8df3c337c400 00100000:10000000:3.0:1789601626.467221:0:15660:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789601626.481960:0:15660:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f13f8 00000020:00000080:2.0:1789601626.481973:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c2b0d000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789601626.481986:0:15660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df501e60000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789601626.481989:0:15660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df501e60000 2 00000020:01000004:2.0:1789601626.481992:0:15660:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df501e60000 from lustre-OST0001 00000020:00000080:2.0:1789601626.482016:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601626.482025:0:15660:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789601626.482028:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df4f7391800/lustre-OST0001_UUID 00000020:00000080:2.0:1789601626.482031:0:15660:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f7391800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789601626.482037:0:15660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1789601626.482090:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b0d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1789601626.482730:0:15660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9ae79c1b-f0a7-456b-b85e-4e644036ec22->MGS 00010000:00010000:2.0:1789601626.482751:0:15660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f1151 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601626.482764:0:15660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f1151 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601626.483452:0:15660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789601626.483455:0:15660:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789601626.483458:0:15660:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789601626.483473:0:15660:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:2.0:1789601626.483478:0:15660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f1151 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f1158 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.483499:0:15660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601626.483525:0:15660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601626.483531:0:15660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601626.483533:0:15660:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789601626.483535:0:15660:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789601626.483545:0:15660:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df4f37cf800 00010000:00010000:2.0:1789601626.483548:0:15660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7362c00/0x74872e3eca9f15c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x74872e3eca9f15cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789601626.483607:0:15660:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cf800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789601626.483611:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789601626.483614:0:15660:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789601626.483616:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789601626.483621:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789601626.483632:0:15660:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df3c36ac380 x1876532918400128/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789601631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789601626.483660:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789601626.483663:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1789601626.483733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ae79c1b-f0a7-456b-b85e-4e644036ec22:3644:1876532918400128:0@lo:250:kworker.0 10000000:01000000:2.0:1789601626.483854:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789601626.483862:0:15660:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f104e 00000020:00000080:2.0:1789601626.483869:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df4d09d2000/9ae79c1b-f0a7-456b-b85e-4e644036ec22 00000020:01000000:2.0:1789601626.483916:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.148@tcp (flags='') 00000020:00000080:2.0:1789601626.483922:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601626.483928:0:15660:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789601626.483933:0:15660:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8df4f3720000) has no exports 10000000:01000000:3.0:1789601626.484071:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789601626.484237:0:15660:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.148@tcp: client import never connected 00000100:00080000:2.0:1789601626.484240:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789601626.484242:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789601626.484245:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789601626.484254:0:15660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789601626.487440:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4d09d2000/9ae79c1b-f0a7-456b-b85e-4e644036ec22 for MGC192.168.203.148@tcp 00000020:00000080:2.0:1789601626.487605:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601626.487619:0:15660:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.148@tcp (uuid 9ae79c1b-f0a7-456b-b85e-4e644036ec22) 00000020:01000000:3.0:1789601626.487701:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789601626.487709:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601626.487717:0:15660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789601626.487724:0:15660:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8df3c23d8800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1789601626.487726:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f37cf800 for MGC192.168.203.148@tcp 00000020:00080000:3.0:1789601626.487734:0:15660:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8df4f7268000) has exports, disconnecting them 00000020:00000080:1.0:1789601626.487737:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df4f37cb800/9ae79c1b-f0a7-456b-b85e-4e644036ec22 00000020:00080000:3.0:1789601626.487742:0:15660:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8df3c23d8800), last request at 1789601394 00000020:00000080:1.0:1789601626.487743:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4f37cb800/9ae79c1b-f0a7-456b-b85e-4e644036ec22 for MGC192.168.203.148@tcp 00000020:00000080:3.0:1789601626.487751:0:15660:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1422 00000020:01000000:1.0:1789601626.487752:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.148@tcp (9ae79c1b-f0a7-456b-b85e-4e644036ec22) 00000020:00080000:3.0:1789601626.487770:0:15660:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df3c23d8800): rc 0 00000020:00000080:3.0:1789601626.487775:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c23d8800/lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789601626.488922:0:15660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789601626.488928:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789601626.488932:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789601626.488938:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789601626.489093:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601626.489101:0:15660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789601626.489107:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789601626.489111:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601626.489115:0:15660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789601626.489120:0:15660:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8df3c2b08000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789601626.489127:0:15660:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8df3c21019c0) has exports, disconnecting them 00000020:00080000:2.0:1789601626.489132:0:15660:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8df3c2b08000), last request at 1789601394 00000020:00000080:2.0:1789601626.489135:0:15660:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f1437 00000020:00080000:2.0:1789601626.489149:0:15660:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df3c2b08000): rc 0 00000020:00000080:2.0:1789601626.489153:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c2b08000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789601626.492666:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c23d8800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789601626.492682:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df4f7392000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789601626.492690:0:1385:0:(genops.c:885:class_export_put()) final put ffff8df3c2afb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789601626.492693:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2afb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789601626.492697:0:1385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789601626.492748:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b08000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789601626.493676:0:15660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789601626.493682:0:15660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789601626.493686:0:15660:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789601626.493691:0:15660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789601626.493721:0:1385:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df3c2b0f800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789601626.519489:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789601626.519749:0:7464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789601626.519978:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789601626.520730:0:7463:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8df4c66eec00:7463] 2 exiting: rc = 0 00000100:00100000:0.0:1789601626.522893:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8df4c4345800:6505] 1 exiting: rc = 0 00000100:00100000:3.0:1789601626.522956:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8df4c4344c00:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1789601626.523180:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.523617:0:7465:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8df4eb9d2a00:7465] 3 exiting: rc = 0 00000100:00100000:3.0:1789601626.523623:0:6506:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8df4c4345e00:6506] 0 exiting: rc = 1 00000100:00100000:0.0:1789601626.523986:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8df4c4345000:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1789601626.524048:0:6508:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8df4c4ef2e00:6508] 2 exiting: rc = 0 00000100:00100000:1.0:1789601626.524314:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524325:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524336:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524350:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524358:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524370:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524390:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524397:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524404:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524410:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524418:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524424:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524429:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524437:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524443:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524449:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524453:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524458:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524465:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524470:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524476:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524482:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524488:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524494:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524499:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524504:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524510:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524515:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524521:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524526:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524532:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524537:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524543:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524547:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524553:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524581:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524587:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524592:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524603:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524611:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524616:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524627:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524632:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524636:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524642:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524647:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524664:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524671:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524676:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524681:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524686:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524691:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524696:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524701:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524706:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524711:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524715:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524720:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524725:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524730:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524734:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524739:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524744:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.524749:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789601626.526075:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601626.526085:0:15660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789601626.526091:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c2b08800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789601626.526096:0:15660:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c2b08800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789601626.526102:0:15660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789601626.526153:0:15660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df501e60000 1 00000020:00000080:1.0:1789601626.526160:0:15660:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x74872e3eca9f13c7 00000020:00000080:1.0:1789601626.526167:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c23df000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789601626.526186:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789601626.526198:0:1385:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c23df000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789601626.526210:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601626.526222:0:15660:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789601626.526226:0:15660:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8df4f7353380) has no exports 00000020:00000080:1.0:1789601626.625269:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601626.625283:0:15660:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789601626.625289:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df3c19c9800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789601626.625294:0:15660:0:(genops.c:844:class_export_destroy()) destroying export ffff8df3c19c9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789601626.625300:0:15660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789601626.625615:0:15660:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df3c19ca000 00000020:01000000:1.0:1789601626.625634:0:15660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789601626.625638:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601626.625642:0:15660:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789601626.625647:0:15660:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8df4f763cd40) has no exports 00000020:00000080:1.0:1789601626.625668:0:15660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601626.625672:0:15660:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789601626.625675:0:15660:0:(genops.c:885:class_export_put()) final put ffff8df4cd0db000/OSS_uuid 00000020:00000080:1.0:1789601626.625677:0:15660:0:(genops.c:844:class_export_destroy()) destroying export ffff8df4cd0db000/OSS_uuid for OSS 00000020:01000000:1.0:1789601626.625680:0:15660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789601626.625706:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789601626.625898:0:8857:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8df4f72c2200:8857] 3 exiting: rc = 0 00000100:00100000:1.0:1789601626.625951:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8df4f8aa6a00:8441] 2 exiting: rc = 0 00000100:00100000:1.0:1789601626.625995:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8df4f375ea00:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1789601626.626237:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8df4f375fa00:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1789601626.634452:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634464:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634470:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634476:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634483:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634488:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634494:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634499:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634505:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634510:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634515:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634520:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634524:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634543:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634548:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634553:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634697:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634703:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634708:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634714:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634719:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634724:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634730:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634735:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634741:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634747:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634752:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634757:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634762:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634767:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634773:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634778:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634783:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634788:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634793:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634799:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634804:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634809:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634823:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634829:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634834:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634839:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634844:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634849:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634853:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634859:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634864:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634868:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634882:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634887:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634892:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634902:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634908:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634914:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634920:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634925:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634930:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634939:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634950:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634957:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634962:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634968:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634973:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.634978:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601626.636163:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8df4f9c7a400:8443] 1 exiting: rc = 0 00000100:00100000:3.0:1789601626.636400:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8df4f9c79600:8442] 0 exiting: rc = 1 00000100:00100000:1.0:1789601626.636490:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636498:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636506:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636511:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636517:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636522:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636527:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636533:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636538:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636543:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636548:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636829:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636840:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636845:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636850:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636855:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636860:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636864:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636869:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636888:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636894:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636898:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636904:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636910:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636916:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636922:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636928:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636933:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636940:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636946:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636950:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636956:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636961:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636966:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636971:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636976:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636982:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.636994:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637023:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637030:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637035:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637040:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637045:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637049:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637054:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637059:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637064:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637069:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637073:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637079:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637084:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637088:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637094:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637100:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637113:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637117:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637122:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637127:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637132:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637138:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637143:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637148:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637154:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.637159:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601626.639094:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8df4f9c7b200:8445] 1 exiting: rc = 0 00000100:00100000:3.0:1789601626.639285:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8df4f9c79400:8444] 0 exiting: rc = 1 00000100:00100000:1.0:1789601626.639730:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8df4f9c7b000:8446] 2 exiting: rc = 0 00000100:00100000:0.0:1789601626.639877:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639886:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639891:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639897:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639912:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639926:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639932:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639939:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639944:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639950:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639957:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639962:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639968:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639975:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639981:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.639998:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640003:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640008:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640015:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640020:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640025:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640045:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640051:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640055:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640061:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640067:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640072:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640078:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640084:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640102:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640109:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640115:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640120:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640125:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640132:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640137:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640143:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640148:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640154:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640160:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640165:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640170:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640176:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640181:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640186:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640192:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640198:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640203:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640210:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640216:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640228:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640233:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640240:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640258:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640265:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640270:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640277:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640283:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640289:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640294:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640301:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640307:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640313:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.640319:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601626.649229:0:8448:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8df501fc5800:8448] 1 exiting: rc = 0 00000100:00100000:3.0:1789601626.649656:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8df4f74a7400:8447] 0 exiting: rc = 1 00000100:00100000:0.0:1789601626.649800:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649809:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649824:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649829:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649834:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649840:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649845:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649851:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649855:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649860:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649866:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649871:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649878:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649883:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649899:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649904:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649909:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649914:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649919:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649924:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649929:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649944:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649950:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649955:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649959:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649964:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649969:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649974:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649980:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649985:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649991:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.649996:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650001:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650005:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650015:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650020:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650025:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650030:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650035:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650039:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650043:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650048:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650053:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650058:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650063:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650068:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650073:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650077:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650083:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650088:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650093:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650098:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650103:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650109:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650114:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650120:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650132:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650137:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650144:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650149:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650154:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650159:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650165:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.650179:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601626.651377:0:8450:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8df4f74a7e00:8450] 1 exiting: rc = 0 00000100:00100000:2.0:1789601626.655436:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8df4f7102800:8449] 0 exiting: rc = 1 00000100:00100000:0.0:1789601626.655689:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655698:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655711:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655733:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655739:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655747:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655753:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655759:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655765:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655771:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655776:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655783:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655789:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655795:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655801:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655831:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655841:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655846:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655852:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655858:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655863:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655869:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655877:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655885:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655895:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655902:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655907:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655946:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655954:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655960:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655967:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655973:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655979:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655986:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655992:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.655999:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656004:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656010:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656016:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656037:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656044:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656049:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656055:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656061:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656067:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656073:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656078:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656083:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656090:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656096:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656102:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656122:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656128:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656134:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656140:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656146:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656151:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656156:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656161:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656166:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656171:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656176:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656189:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601626.656195:0:15660:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789601626.663886:0:15660:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789601648.721976:0:16424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789601659.746178:0:17024:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789601659.746186:0:17024:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789601659.746187:0:17024:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789601659.746291:0:17024:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df3c41ab800 00000020:01000004:0.0:1789601659.746307:0:17024:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789601659.746315:0:17024:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789601659.746328:0:17024:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8df4f726b380) 00000020:00000080:0.0:1789601659.746342:0:17024:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789601659.855627:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789601659.857000:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.862501:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.862881:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.863140:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.863490:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.863923:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.864147:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.864533:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.864842:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.865039:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.865725:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.866050:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.866589:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.866856:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789601659.867039:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789601659.867539:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.870244:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.870932:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.871213:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.871547:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.871789:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.873403:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.874097:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.874670:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.874921:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.875726:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.875988:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.876422:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.876743:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.876934:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.877275:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.877751:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789601659.878004:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789601659.879020:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789601659.879533:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.880694:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.880881:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.881246:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.881428:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.881788:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789601659.882008:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789601659.882373:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1789601659.884757:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789601659.885300:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789601659.885547:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.887931:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.892081:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.894433:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.895753:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.898481:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.900864:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789601659.901887:0:17024:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1789601659.903053:0:17024:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789601659.903305:0:17024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789601659.903314:0:17024:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789601659.906747:0:17024:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f25fd 00000020:01000004:0.0:1789601659.906762:0:17024:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789601659.906768:0:17024:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789601659.906775:0:17024:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df3c41ab800 from MGS 00000020:01000004:0.0:1789601659.906780:0:17024:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789601659.906793:0:17024:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8df4f7268000) 00000020:00000080:0.0:1789601659.906806:0:17024:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789601659.906873:0:17024:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df3c41ab800 from MGS, refs=2 00080000:01000000:0.0:1789601659.906880:0:17024:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789601659.906884:0:17024:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f260b 00000100:00100000:0.0:1789601659.907019:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789601659.907255:0:17024:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789601659.907262:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789601659.908008:0:17024:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789601659.908017:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789601659.908955:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601659.909303:0:17024:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789601659.909309:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789601659.911761:0:17024:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789601659.911774:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789601659.913694:0:17024:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789601659.913706:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789601659.914429:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601659.914433:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601659.914440:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601659.914784:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601659.914787:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601659.914789:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601659.915483:0:17024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789601659.917395:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789601659.922778:0:17024:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789601659.923704:0:17036:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789601659.923758:0:17024:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789601659.923798:0:17024:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789601659.924401:0:17024:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789601659.924753:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601659.924896:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789601659.924902:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789601659.925628:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789601659.925636:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789601659.926165:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789601659.926172:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789601659.935661:0:17024:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789601659.935687:0:17024:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:1.0:1789601659.935689:0:17024:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789601659.935721:0:17024:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:1.0:1789601659.935734:0:17024:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (ffff8df4f7638000) 00000020:00000080:1.0:1789601659.935751:0:17024:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789601659.935834:0:17024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4ff55d800@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789601659.936009:0:17024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:1.0:1789601659.936016:0:17024:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789601659.936152:0:17041:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789601659.941802:0:17042:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789601659.942093:0:17024:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid 0068b5de-bd03-471c-817a-758c66ef4c46) 00000020:00000080:0.0:1789601659.942123:0:17024:0:(genops.c:1384:class_connect()) connect: client 0068b5de-bd03-471c-817a-758c66ef4c46, cookie 0x74872e3eca9f2619 00000100:00080000:0.0:1789601659.942140:0:17024:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601659.942154:0:17024:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8df4ff55d800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601659.942190:0:17024:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4067100 x1876532918400640/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601659.942224:0:17024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0068b5de-bd03-471c-817a-758c66ef4c46->MGS 00000020:01000004:0.0:1789601659.942242:0:17024:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789601659.942247:0:17024:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789601659.942261:0:17024:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8df4f726cd40) 00000020:00000080:0.0:1789601659.942273:0:17024:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789601659.945779:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0068b5de-bd03-471c-817a-758c66ef4c46:3644:1876532918400640:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789601659.945867:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601659.945965:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918400640 00000100:00100000:2.0:1789601659.945977:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918400640 00000100:00100000:2.0:1789601659.946009:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601659.946016:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876532918400640:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789601659.946048:0:17037:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0068b5de-bd03-471c-817a-758c66ef4c46@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1789601659.946077:0:17037:0:(genops.c:1384:class_connect()) connect: client 0068b5de-bd03-471c-817a-758c66ef4c46, cookie 0x74872e3eca9f2627 00000100:00080000:2.0:1789601659.946236:0:17037:0:(import.c:65:import_set_state_nolock()) ffff8df3c373f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601659.946295:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+5:3644:x1876532918400640:12345-0@lo:250:mount.lustre.0 Request processed in 278us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601659.946302:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601659.946359:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789601659.946367:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1789601659.946375:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789601659.946380:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789601659.946383:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4ff55d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789601659.946385:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789601659.956393:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789601659.956636:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0068b5de-bd03-471c-817a-758c66ef4c46:3644:1876532918400640:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789601659.959869:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601659.960058:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789601659.960067:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789601659.963817:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789601659.963833:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789601659.967519:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789601659.973454:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789601659.978005:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601659.978413:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789601659.978420:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789601659.980741:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789601659.980754:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789601660.081501:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601660.081774:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789601660.081781:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789601660.084136:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789601660.084150:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789601660.086661:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601660.086854:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789601660.086860:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789601660.094861:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789601660.094874:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789601660.095495:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601660.095720:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789601660.095726:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789601660.096427:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789601660.096435:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789601660.097410:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601660.097624:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789601660.097629:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789601660.108494:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789601660.113905:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789601660.212264:0:17024:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601660.213479:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789601660.213488:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789601660.218202:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789601660.218217:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789601660.220220:0:17024:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789601660.220236:0:17024:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789601660.227917:0:17024:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789601660.227957:0:17024:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789601660.227964:0:17024:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789601660.228089:0:17024:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789601660.228132:0:17024:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789601660.228137:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789601660.228139:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601660.228141:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601660.228143:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601660.228144:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601660.228146:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601660.228147:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601660.228149:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601660.228150:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601660.228151:0:17024:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601660.228154:0:17024:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789601660.228157:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601660.228158:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601660.228159:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601660.228160:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601660.228162:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601660.228163:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601660.228164:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601660.228165:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601660.228166:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601660.228166:0:17024:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601660.228193:0:17024:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789601660.228212:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918400768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789601660.228280:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.228350:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601660.229126:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918400768 00000100:00100000:2.0:1789601660.229136:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918400768 00000100:00100000:2.0:1789601660.229193:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601660.229203:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+5:17024:x1876532918400768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789601660.229259:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789601660.229263:0:17039:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789601660.229265:0:17039:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789601660.230486:0:17061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789601660.231026:0:17039:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789601660.233821:0:17062:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789601660.233829:0:17062:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789601660.233832:0:17062:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789601660.233836:0:17062:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789601660.234149:0:17062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789601660.240088:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789601660.240102:0:17039:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789601660.244525:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+5:17024:x1876532918400768:12345-0@lo:253:mount.lustre.0 Request processed in 15314us (16235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.244540:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601660.248078:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918400768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789601660.248113:0:17024:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789601660.248117:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601660.248118:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601660.248120:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601660.248121:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601660.248123:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601660.248124:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601660.248125:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601660.248127:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601660.248128:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601660.248130:0:17024:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789601660.248156:0:17024:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df3c41ab800 from lustre-MDT0000 10000000:01000000:1.0:1789601660.248194:0:17024:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789601660.248197:0:17024:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601660.248201:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df4f7638000 10000000:01000000:1.0:1789601660.248205:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601660.248213:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df4f7638000 from 1 10000000:01000000:1.0:1789601660.248216:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789601660.248257:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.248268:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.248277:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.248316:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918400896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601660.248393:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.248447:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601660.249355:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918400896 00000100:00100000:2.0:1789601660.249364:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918400896 00000100:00100000:2.0:1789601660.249425:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601660.249436:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+5:17024:x1876532918400896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601660.249452:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601660.249472:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d000/0x74872e3eca9f2635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f262e expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.249502:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d000/0x74872e3eca9f2635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f262e expref: 6 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.249526:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d000/0x74872e3eca9f2635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f262e expref: 6 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.249535:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d000, rc 0) 00000100:00100000:2.0:1789601660.249627:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+6:17024:x1876532918400896:12345-0@lo:101:mount.lustre.0 Request processed in 193us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.249634:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601660.249869:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918400896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601660.249886:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.249897:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.249966:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601660.249998:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.250022:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601660.250545:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401024 00000100:00100000:2.0:1789601660.250551:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401024 00000100:00100000:2.0:1789601660.250675:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601660.250684:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+6:17024:x1876532918401024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601660.250771:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+6:17024:x1876532918401024:12345-0@lo:501:mount.lustre.0 Request processed in 89us (772us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601660.250778:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601660.250935:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789601660.250966:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601660.250989:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.250999:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601660.251007:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df3c41ab800 10000000:01000000:1.0:1789601660.251012:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789601660.251015:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df3c41ab800 10000000:01000000:1.0:1789601660.251017:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789601660.251020:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df3c41ab800 from 1 10000000:01000000:1.0:1789601660.251031:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789601660.251054:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.251061:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.251070:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.251096:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601660.251128:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.259505:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601660.262213:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401152 00000100:00100000:3.0:1789601660.262229:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401152 00000100:00100000:2.0:1789601660.262371:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601660.262385:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+6:17024:x1876532918401152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601660.262403:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601660.262426:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d600/0x74872e3eca9f2643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f263c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.262457:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d600/0x74872e3eca9f2643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f263c expref: 7 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.262469:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d600/0x74872e3eca9f2643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f263c expref: 7 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.262477:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d600, rc 0) 00000100:00100000:2.0:1789601660.262590:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+7:17024:x1876532918401152:12345-0@lo:101:mount.lustre.0 Request processed in 209us (11462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.262597:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601660.264816:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601660.264847:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2643 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.264861:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2643 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601660.264880:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789601660.264891:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2643 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.264899:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73efa00/0x74872e3eca9f263c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2643 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601660.264908:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601660.264917:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601660.264936:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df3c41ab800 10000000:01000000:1.0:1789601660.264938:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789601660.264943:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789601660.264945:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601660.264976:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.264983:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.264991:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.265009:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601660.265065:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.265102:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.265920:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401280 00000100:00100000:0.0:1789601660.265930:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401280 00000100:00100000:0.0:1789601660.265975:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601660.265984:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+7:17024:x1876532918401280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601660.265998:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601660.266013:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f2651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f264a expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.266037:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f2651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f264a expref: 8 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.266058:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466600/0x74872e3eca9f2651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f264a expref: 8 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.266067:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466600, rc 0) 00000100:00100000:0.0:1789601660.266138:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+8:17024:x1876532918401280:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.266145:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601660.266294:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601660.266308:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2651 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.266318:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2651 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.266392:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601660.266424:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.266459:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.266544:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401408 00000100:00100000:0.0:1789601660.266549:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401408 00000100:00100000:0.0:1789601660.266603:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601660.266609:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+8:17024:x1876532918401408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601660.266741:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+9:17024:x1876532918401408:12345-0@lo:501:mount.lustre.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.266748:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601660.266819:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601660.266845:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601660.266884:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.266908:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.267106:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401536 00000100:00100000:0.0:1789601660.267111:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401536 00000100:00100000:0.0:1789601660.267128:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601660.267133:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+9:17024:x1876532918401536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601660.267903:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+9:17024:x1876532918401536:12345-0@lo:503:mount.lustre.0 Request processed in 766us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.267911:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601660.267985:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918401536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601660.269695:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17063:1876532918401664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601660.269763:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.270962:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601660.273971:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401664 00000100:00100000:3.0:1789601660.273989:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401664 00000100:00100000:3.0:1789601660.274062:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601660.274072:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+9:17063:x1876532918401664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.276327:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+9:17063:x1876532918401664:12345-0@lo:502:llog_process_th.0 Request processed in 2245us (6552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601660.276341:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601660.276464:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17063:1876532918401664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601660.276502:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601660.276513:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.276515:0:17063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789601660.276520:0:17063:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789601660.276523:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601660.276540:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8df4f763cd40) 00000020:00000080:1.0:1789601660.276613:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789601660.276636:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789601660.276717:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789601660.276724:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f265f 00000020:00000080:1.0:1789601660.276955:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789601660.276959:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.276963:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.276965:0:17063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789601660.276968:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601660.276972:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.276973:0:17063:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789601660.276976:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601660.276983:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8df4f763b380) 00000020:00000080:1.0:1789601660.276993:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789601660.276997:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789601660.276998:0:17063:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789601660.277007:0:17063:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789601660.277014:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789601660.277062:0:17063:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df3c41ab800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789601660.277075:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8df4f76399c0) 00000020:00000080:1.0:1789601660.277096:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789601660.277153:0:17063:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789601660.277158:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f2674 00000020:00000080:1.0:1789601660.277242:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789601660.277247:0:17063:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789601660.277251:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x74872e3eca9f267b 00080000:01000000:1.0:1789601660.277256:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789601660.277260:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f2682 00010000:00010000:3.0:1789601660.412249:0:17063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789601660.412871:0:17063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789601660.413194:0:17063:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789601660.413811:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8df4f73519c0) 00000020:00000080:3.0:1789601660.413831:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789601660.413918:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789601660.413925:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f2690 00000020:00000080:3.0:1789601660.416016:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789601660.422245:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x74872e3eca9f2697 00000020:00000080:0.0:1789601660.423868:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789601660.423884:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601660.423892:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601660.423895:0:17063:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789601660.423898:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789601660.423912:0:17063:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789601660.423914:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789601660.423915:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789601660.423917:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789601660.423920:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601660.423922:0:17063:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789601660.423925:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601660.423930:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601660.423932:0:17063:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789601660.423937:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789601660.424003:0:17063:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789601660.424024:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601660.424028:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601660.424030:0:17063:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789601660.424032:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601660.424035:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601660.424037:0:17063:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789601660.424039:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601660.424044:0:17063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:00000080:0.0:1789601660.424075:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601660.424103:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8df4f72699c0) 00000020:00000080:0.0:1789601660.424119:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789601660.424125:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601660.429211:0:17063:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789601660.429224:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789601660.429239:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f26a5 00010000:00080000:0.0:1789601660.429278:0:17063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4d09a9800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789601660.436481:0:17063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789601660.448285:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789601660.448303:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789601660.448347:0:17063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789601660.448372:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f26ac 00000100:00080000:1.0:1789601660.448383:0:17063:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601660.448396:0:17063:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4d09a9800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601660.448456:0:17063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359f800 x1876532918401792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601660.448500:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918401792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789601660.448593:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789601660.448675:0:17063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789601660.448931:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918401792 00000100:00100000:0.0:1789601660.448939:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918401792 00000100:00100000:0.0:1789601660.448973:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601660.448980:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918401792:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789601660.449009:0:17050:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:1.0:1789601660.452461:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.452469:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.452471:0:17063:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789601660.452475:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789601660.452478:0:17063:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789601660.452480:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601660.452481:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601660.452483:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789601660.452494:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.452496:0:17063:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789601660.452499:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601660.452505:0:17063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789601660.452507:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.452509:0:17063:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789601660.452512:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789601660.452516:0:17063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:1.0:1789601660.452541:0:17063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789601660.452544:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601660.452600:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df4fb5399c0) 00000020:00000080:1.0:1789601660.452622:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789601660.452630:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789601660.454945:0:17063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789601660.454959:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789601660.454974:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f26ba 00010000:00080000:1.0:1789601660.455014:0:17063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f70a0800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789601660.455269:0:17063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789601660.461040:0:17063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789601660.461971:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789601660.480841:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601660.481400:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789601660.490326:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1789601660.493951:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918401792:12345-0@lo:38:llog_process_th.0 Request processed in 44959us (45347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601660.493971:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1789601660.494602:0:17069:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789601660.494607:0:17069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1789601660.494969:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601660.494975:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601660.494979:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918401792:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1789601660.495599:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789601660.495611:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789601660.495645:0:17063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789601660.495665:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f26c1 00000100:00080000:1.0:1789601660.495672:0:17063:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601660.495687:0:17063:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df4f70a0800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601660.495719:0:17063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359c700 x1876532918401920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601660.495742:0:17063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789601660.495809:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.495813:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.495815:0:17063:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789601660.495818:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789601660.495820:0:17063:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1789601660.495822:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601660.495823:0:17063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789601660.495825:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789601660.495827:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.495829:0:17063:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789601660.495831:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601660.495835:0:17063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789601660.495839:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.495840:0:17063:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789601660.495843:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789601660.495847:0:17063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:1.0:1789601660.495869:0:17063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789601660.495872:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601660.495882:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df4fb538000) 00000020:00000080:1.0:1789601660.495893:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789601660.495897:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789601660.495953:0:17063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789601660.495959:0:17063:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789601660.495965:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x74872e3eca9f26cf 00010000:00080000:1.0:1789601660.495989:0:17063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c2b0f800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00000100:00100000:3.0:1789601660.496310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918401920:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789601660.496370:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918401920 offset 0 length 520: 4 00010000:00010000:1.0:1789601660.496692:0:17063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789601660.496832:0:17063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789601660.496859:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789601660.498482:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601660.498960:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789601660.499183:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789601660.500055:0:17071:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789601660.500061:0:17071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789601660.501013:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789601660.501025:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789601660.501060:0:17063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789601660.501160:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f26d6 00000100:00080000:1.0:1789601660.501172:0:17063:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601660.501185:0:17063:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601660.501221:0:17063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359f100 x1876532918402048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601660.501249:0:17063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789601660.501356:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.501360:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.501362:0:17063:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789601660.501365:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601660.501369:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.501370:0:17063:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789601660.501373:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789601660.501375:0:17063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789601660.501377:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.501379:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.501380:0:17063:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789601660.501382:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601660.501384:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.501386:0:17063:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789601660.501390:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789601660.501424:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17063:1876532918402176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601660.501501:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.501550:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402176 00000100:00100000:1.0:1789601660.501595:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402176 00000100:00100000:1.0:1789601660.501637:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601660.501645:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+9:17063:x1876532918402176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601660.501750:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+9:17063:x1876532918402176:12345-0@lo:502:llog_process_th.0 Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601660.501758:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601660.501882:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601660.501905:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17063:1876532918402176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601660.501931:0:17063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601660.501935:0:17063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601660.501936:0:17063:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789601660.501939:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789601660.501988:0:17024:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789601660.502007:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789601660.502022:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2651 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.502033:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee400/0x74872e3eca9f264a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2651 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601660.502041:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df3c41ab800 from 1 10000000:01000000:1.0:1789601660.502044:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601660.502069:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.502077:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601660.502226:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601660.502248:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601660.502278:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601660.502339:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601660.502484:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918402048:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789601660.502516:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918402048 offset 0 length 520: 4 00000100:00100000:0.0:1789601660.509099:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402304 00000100:00100000:0.0:1789601660.509115:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402304 00000100:00100000:0.0:1789601660.509174:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601660.509184:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+9:17024:x1876532918402304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601660.509200:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601660.509218:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f26dd expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.509244:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 10 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.509256:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 10 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.509265:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466800, rc 0) 00000100:00100000:3.0:1789601660.514984:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601660.515023:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601660.515036:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601660.517007:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402432:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789601660.517157:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.517246:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.517885:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+10:17024:x1876532918402304:12345-0@lo:101:mount.lustre.0 Request processed in 165us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.517895:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601660.517974:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402432 00000100:00100000:0.0:1789601660.517981:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402432 00000100:00100000:0.0:1789601660.518039:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601660.518165:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+10:17024:x1876532918402432:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789601660.518185:0:17038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789601660.518191:0:17038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789601660.518283:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+10:17024:x1876532918402432:12345-0@lo:256:mount.lustre.0 Request processed in 236us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.518290:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789601660.518445:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402432:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789601660.519071:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601660.519152:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601660.519164:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601660.519171:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df3c41ab800 from 1 10000000:01000000:3.0:1789601660.519225:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601660.519256:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601660.519264:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601660.519273:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601660.519290:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601660.519325:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.519409:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.519446:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402560 00000100:00100000:0.0:1789601660.519451:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402560 00000100:00100000:0.0:1789601660.519519:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601660.519527:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+10:17024:x1876532918402560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601660.519537:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601660.519549:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f26eb expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.519610:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 11 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.519621:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 11 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.519628:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467e00, rc 0) 00000100:00100000:0.0:1789601660.519658:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918402560:12345-0@lo:101:mount.lustre.0 Request processed in 132us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.519664:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601660.519737:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601660.519750:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601660.519759:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601660.519829:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601660.519855:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.520042:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601660.520193:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402688 00000100:00100000:2.0:1789601660.520199:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402688 00000100:00100000:2.0:1789601660.520224:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601660.520230:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918402688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601660.520359:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918402688:12345-0@lo:501:mount.lustre.0 Request processed in 128us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.520367:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601660.520441:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601660.520471:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601660.520512:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.520805:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.520895:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402816 00000100:00100000:0.0:1789601660.520901:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402816 00000100:00100000:2.0:1789601660.520950:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601660.520958:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918402816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601660.521050:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918402816:12345-0@lo:503:mount.lustre.0 Request processed in 93us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.521058:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601660.523223:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918402816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601660.524185:0:17073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17073:1876532918402944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.524255:0:17073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.524299:0:17073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601660.524350:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918402944 00000100:00100000:1.0:1789601660.524357:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918402944 00000100:00100000:1.0:1789601660.524439:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601660.524448:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+11:17073:x1876532918402944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601660.525107:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+11:17073:x1876532918402944:12345-0@lo:502:llog_process_th.0 Request processed in 658us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601660.525116:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601660.525218:0:17073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17073:1876532918402944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601660.525243:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601660.525252:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525254:0:17073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789601660.525261:0:17073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df3c41ab800 00000020:00000080:3.0:1789601660.525263:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601660.525271:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601660.525273:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525275:0:17073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789601660.525277:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601660.525279:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525281:0:17073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789601660.525284:0:17073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df3c41ab800 00000020:00000080:3.0:1789601660.525286:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601660.525334:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601660.525338:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525339:0:17073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789601660.525342:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601660.525344:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525345:0:17073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601660.525349:0:17073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df3c41ab800 00000020:00000080:3.0:1789601660.525351:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601660.525368:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601660.525371:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525372:0:17073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601660.525374:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601660.525377:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.525378:0:17073:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789601660.525388:0:17073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df3c41ab800 00000020:00000080:3.0:1789601660.525391:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789601660.525429:0:17073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17073:1876532918403072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.525467:0:17073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.529584:0:17073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.532194:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403072 00000100:00100000:0.0:1789601660.532209:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403072 00000100:00100000:0.0:1789601660.532267:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601660.532277:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+11:17073:x1876532918403072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601660.532460:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+11:17073:x1876532918403072:12345-0@lo:502:llog_process_th.0 Request processed in 184us (6991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.532477:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601660.532640:0:17073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17073:1876532918403072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601660.532673:0:17073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601660.532680:0:17073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601660.532683:0:17073:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789601660.532687:0:17073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789601660.532892:0:17024:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789601660.532919:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601660.532942:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.532954:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601660.533002:0:17024:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789601660.533005:0:17024:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df3c41ab800 10000000:01000000:0.0:1789601660.533009:0:17024:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df3c41ab800 10000000:01000000:0.0:1789601660.533012:0:17024:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601660.533019:0:17024:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df3c41ab800 from 1 10000000:01000000:0.0:1789601660.533022:0:17024:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789601660.533052:0:17024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533062:0:17024:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533070:0:17024:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601660.533099:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601660.533137:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601660.533165:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.533180:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403200 00000100:00100000:0.0:1789601660.533184:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403200 00000100:00100000:0.0:1789601660.533211:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601660.533218:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+11:17024:x1876532918403200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601660.533228:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601660.533239:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467a00/0x74872e3eca9f2700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f26f9 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533261:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467a00/0x74872e3eca9f2700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f26f9 expref: 12 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533271:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467a00/0x74872e3eca9f2700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f26f9 expref: 12 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533280:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467a00, rc 0) 00000100:00100000:0.0:1789601660.533311:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918403200:12345-0@lo:101:mount.lustre.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.533317:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601660.533351:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601660.533365:0:17024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2700 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.533374:0:17024:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2700 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601660.533423:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601660.533447:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601660.533460:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.533473:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403328 00000100:00100000:0.0:1789601660.533476:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403328 00000100:00100000:0.0:1789601660.533500:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601660.533505:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918403328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601660.533637:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918403328:12345-0@lo:501:mount.lustre.0 Request processed in 130us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.533644:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601660.533679:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601660.533706:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601660.533737:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601660.533750:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.533763:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403456 00000100:00100000:0.0:1789601660.534606:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403456 00000100:00100000:0.0:1789601660.534638:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601660.534644:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918403456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601660.534753:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918403456:12345-0@lo:503:mount.lustre.0 Request processed in 108us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.534760:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601660.534894:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918403456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601660.536944:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601660.537016:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601660.537058:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.537177:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403584 00000100:00100000:0.0:1789601660.537185:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403584 00000100:00100000:0.0:1789601660.537222:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601660.537231:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601660.537352:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403584:12345-0@lo:502:llog_process_th.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.537360:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601660.537455:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403584:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789601660.537510:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789601660.537524:0:17077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8df3c2103380) 00000020:00000080:2.0:1789601660.537541:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789601660.537672:0:17077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df3c41ab800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789601660.537677:0:17077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df3c41ab800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789601660.537679:0:17077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df3c41ab800 4 00010000:00080000:2.0:1789601660.537707:0:17077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f37cb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601660.541427:0:17077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789601660.543334:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789601660.543383:0:17077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601660.543396:0:17077:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x74872e3eca9f270e 00000100:00080000:3.0:1789601660.543409:0:17077:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601660.543421:0:17077:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df4f37cb000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601660.543457:0:17077:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c5180 x1876532918403712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601660.543500:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918403712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789601660.543595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601660.543649:0:17077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789601660.543849:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403712 00000100:00100000:0.0:1789601660.543862:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403712 00000100:00100000:0.0:1789601660.543895:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601660.543902:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918403712:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601660.543962:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918403712:12345-0@lo:38:llog_process_th.0 Request processed in 60us (367us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789601660.543969:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601660.545229:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601660.545240:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601660.545245:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789601660.545249:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918403712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789601660.545379:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.545443:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.545472:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403840 00000100:00100000:3.0:1789601660.545478:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403840 00000100:00100000:3.0:1789601660.545512:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601660.545520:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.545655:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403840:12345-0@lo:502:llog_process_th.0 Request processed in 134us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601660.545662:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601660.545708:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601660.545722:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.545757:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601660.546913:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601660.557041:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8aa36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.557427:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918403968 00000100:00100000:0.0:1789601660.557436:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918403968 00000100:00100000:0.0:1789601660.557527:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601660.557538:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601660.557739:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17077:x1876532918403968:12345-0@lo:502:llog_process_th.0 Request processed in 203us (10829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.557747:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789601660.559709:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0068b5de-bd03-471c-817a-758c66ef4c46:17077:1876532918403968:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789601660.559753:0:17077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789601660.566000:0:17024:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789601660.566040:0:17024:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601660.566064:0:17024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2700 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.566075:0:17024:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3466c00/0x74872e3eca9f26f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2700 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601660.566201:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601660.566203:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601660.566205:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601660.566206:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601660.566207:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601660.566208:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601660.566210:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601660.566211:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601660.566213:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601660.566214:0:17024:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601660.566222:0:17024:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789601660.566224:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601660.566226:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601660.566227:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601660.566227:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601660.566228:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601660.566229:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601660.566230:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601660.566231:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601660.566232:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601660.566232:0:17024:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601660.566258:0:17024:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789601660.566280:0:17024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918404096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601660.566349:0:17024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601660.566387:0:17024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.566436:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404096 00000100:00100000:0.0:1789601660.566443:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404096 00000100:00100000:0.0:1789601660.566500:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601660.566509:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918404096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789601660.566535:0:17037:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789601660.566547:0:17037:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789601660.571251:0:17037:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789601660.571263:0:17037:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789601660.571310:0:17061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789601660.571315:0:17061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789601660.571337:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.571357:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.571366:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.571423:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601660.571437:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601660.571451:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918404224:0@lo:104: 00000100:00100000:0.0:1789601660.571512:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601660.572873:0:17028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404224 00000100:00100000:2.0:1789601660.572884:0:17028:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404224 00000100:00100000:2.0:1789601660.572935:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601660.572944:0:17028:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918404224:12345-0@lo:104: 00010000:00010000:2.0:1789601660.572958:0:17028:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.573022:0:17028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601660.573027:0:17028:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918404224:12345-0@lo:104: Request processed in 85us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.573033:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789601660.573056:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601660.573061:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.573069:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eea00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601660.573073:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.573092:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601660.573099:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601660.573105:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789601660.579151:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601660.579194:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918404224:0@lo:104: 00010000:00010000:0.0:1789601660.579220:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601660.579521:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17024:x1876532918404096:12345-0@lo:253:mount.lustre.0 Request processed in 13012us (13170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601660.579533:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601660.579676:0:17024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17024:1876532918404096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601660.579688:0:17024:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789601660.579691:0:17024:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601660.579693:0:17024:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601660.579695:0:17024:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601660.579696:0:17024:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601660.579697:0:17024:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601660.579699:0:17024:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601660.579700:0:17024:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601660.579701:0:17024:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601660.579703:0:17024:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601660.579704:0:17024:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601660.579717:0:17024:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789601660.583000:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583029:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601660.583059:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583066:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f26dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26e4 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583103:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601660.583105:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601660.583107:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601660.583171:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918404352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601660.583235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601660.583335:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404352 00000100:00100000:2.0:1789601660.583343:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404352 00010000:00010000:2.0:1789601660.583372:0:17030:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601660.583401:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601660.583409:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+12:3648:x1876532918404352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601660.583431:0:17030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601660.583437:0:17030:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583449:0:17030:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583462:0:17030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466800/0x74872e3eca9f26e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f26dd expref: 12 pid: 17038 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583486:0:17030:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583495:0:17030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601660.583510:0:17030:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012195720s 00010000:00010000:2.0:1789601660.583515:0:17030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583521:0:17030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583528:0:17030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583534:0:17030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583540:0:17030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601660.583545:0:17030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583553:0:17030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583606:0:17030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583616:0:17030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601660.583657:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+11:3648:x1876532918404352:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601660.583665:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789601660.583691:0:17061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583699:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601660.583705:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2715 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601660.583739:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918404352:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789601660.613883:0:17024:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789601660.615263:0:17024:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789601660.615333:0:17085:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789601660.615337:0:17085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789601660.616337:0:17086:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789601660.616864:0:17086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789601660.617316:0:17024:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1789601660.617822:0:17087:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8df3c36aea00 x1876532918404480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601660.617845:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000040:00080000:0.0:1789601660.620481:0:17086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789601660.620638:0:17086:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1789601660.621424:0:17024:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789601660.621463:0:17024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789601660.622530:0:17024:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789601660.623181:0:17024:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789601660.623264:0:17024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601660.624516:0:17024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789601660.625475:0:17024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789601660.625519:0:17024:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789601660.627442:0:17024:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789601660.629740:0:17024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789601660.636285:0:17024:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789601660.636339:0:17024:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa27c819cf988 00100000:10000000:3.0:1789601660.636351:0:17024:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789601660.638677:0:17024:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789601660.638701:0:17024:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789601660.638723:0:17024:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789601660.638746:0:17024:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789601660.646473:0:17024:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789601660.649948:0:17024:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789601660.933943:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789601661.022269:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789601661.022279:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df3c41ab800 from 7 10000000:01000000:0.0:1789601661.022285:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601661.022339:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601661.022352:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601661.022363:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601661.022393:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918404608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601661.022462:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601661.022549:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e03b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601661.024227:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404608 00000100:00100000:2.0:1789601661.024241:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404608 00000100:00100000:2.0:1789601661.024309:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601661.024319:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+11:17042:x1876532918404608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601661.024335:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601661.024367:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f271c expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601661.024395:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f271c expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601661.024406:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f271c expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601661.024415:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c400, rc 0) 00000100:00100000:2.0:1789601661.024494:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17042:x1876532918404608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601661.024501:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601661.024671:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918404608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601661.024690:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601661.024700:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601661.024773:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918404736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789601661.024812:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601661.024853:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4e03b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601661.024911:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404736 00000100:00100000:2.0:1789601661.024915:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404736 00000100:00100000:2.0:1789601661.024948:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601661.024955:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17042:x1876532918404736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789601661.024968:0:17037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601661.024984:0:17037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601661.024987:0:17037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789601661.026314:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:17042:x1876532918404736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1353us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601661.026326:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601661.026452:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918404736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789601661.026514:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601661.026523:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601661.026533:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601661.574392:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601661.640606:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789601661.958364:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601662.598186:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601662.661723:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789601662.981842:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601663.685823:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601664.007338:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601664.711659:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789601665.031741:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601665.533452:0:17330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789601665.733916:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000100:00080000:3.0:1789601665.862631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789601665.862638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789601665.862642:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601665.862650:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1789601665.862656:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789601665.862668:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4d09a9800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601665.862691:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c4700 x1876532918404992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601665.862717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601665.862721:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601665.862724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601665.862727:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601665.862730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789601665.862733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601665.862735:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601665.862742:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df4f37cb000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601665.862751:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918404864:0@lo:400:kworker.0 00000100:00100000:3.0:1789601665.862756:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6a00 x1876532918405120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601665.862835:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601665.863264:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918404992:0@lo:38:kworker.0 00000100:00100000:0.0:1789601665.863304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601665.863487:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404992 00000100:00100000:1.0:1789601665.863499:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404992 00000100:00100000:1.0:1789601665.863543:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601665.863551:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876532918404992:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789601665.863587:0:17051:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789601665.864420:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404864 00000100:00100000:3.0:1789601665.864426:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404864 00000100:00100000:3.0:1789601665.864474:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601665.864481:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:3645:x1876532918404864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601665.864554:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:3645:x1876532918404864:12345-0@lo:400:kworker.0 Request processed in 73us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601665.864594:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601665.864628:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918405120:0@lo:38:kworker.0 00000100:00100000:0.0:1789601665.864675:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601665.864872:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918404864:0@lo:400:kworker.0 00000100:00100000:3.0:1789601665.865710:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918405120 00000100:00100000:3.0:1789601665.865717:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918405120 00000100:00100000:3.0:1789601665.865747:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601665.865753:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876532918405120:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789601665.865785:0:17047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1789601665.865820:0:17047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x74872e3eca9f272a 00000004:00100000:3.0:1789601665.865833:0:17047:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789601665.866710:0:17047:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601665.866806:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876532918405120:12345-0@lo:38:kworker.0 Request processed in 1052us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601665.866815:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601665.866840:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df4d09c6a00 x1876532918405120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601665.866856:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789601665.866865:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789601665.866870:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789601665.866873:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f37cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601665.866879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876532918405120:0@lo:38:kworker.0 00000100:00100000:0.0:1789601665.883353:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876532918404992:12345-0@lo:38:kworker.0 Request processed in 19794us (20041us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789601665.883368:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789601665.883623:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601665.883629:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601665.883633:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918404992:0@lo:38:kworker.0 00010000:00010000:3.0:1789601666.063333:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601666.515276:0:17382:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601666.515738:0:17382:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789601666.761238:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:0.0:1789601667.081163:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789601667.303739:0:17432:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789601667.303972:0:17432:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789601667.781902:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601668.101923:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601668.806543:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601669.131060:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601669.834277:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601670.154474:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601670.853653:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000100:00100000:3.0:1789601670.981870:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601660/real 1789601660] req@ffff8df3c359f100 x1876532918402048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601670.981904:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c359f100 x1876532918402048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601670.981931:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601660/real 1789601660] req@ffff8df3c359c700 x1876532918401920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601670.981944:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c359c700 x1876532918401920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789601670.981962:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601670.985854:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789601670.985861:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789601670.985865:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601670.985874:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1789601670.985895:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789601670.985909:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4d09a9800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601670.985935:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4066300 x1876532918405376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601670.985947:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601670.985950:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601670.985953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601670.985956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789601670.985957:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601670.985960:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789601670.985962:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789601670.985966:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601670.985977:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4065880 x1876532918405504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601670.986021:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918405632:0@lo:400:kworker.0 00000100:00100000:0.0:1789601670.986084:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601670.986178:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918405632 00000100:00100000:0.0:1789601670.986185:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918405632 00000100:00100000:0.0:1789601670.986226:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601670.986234:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918405632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601670.986281:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918405632:12345-0@lo:400:kworker.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601670.986299:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789601670.986339:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df3c4065500 x1876532918405632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601670.986363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918405632:0@lo:400:kworker.0 00000100:00100000:2.0:1789601670.986512:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601670.986522:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918405248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601670.986571:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601670.986711:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918405248 00000100:00100000:0.0:1789601670.986716:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918405248 00000100:00100000:0.0:1789601670.986752:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601670.986759:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:3645:x1876532918405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601670.986796:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+12:3645:x1876532918405248:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601670.986802:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601670.986834:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918405248:0@lo:400:kworker.0 00000100:00080000:3.0:1789601670.993471:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789601670.993481:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918402048:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789601670.993511:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601670.993518:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789601670.993522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918401920:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789601670.993616:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405376:0@lo:38:kworker.0 00000100:00100000:3.0:1789601670.993685:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601670.993720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405504:0@lo:8:kworker.0 00000400:00000100:3.0:1789601670.993739:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918405504 offset 0 length 520: 4 00000100:00100000:2.0:1789601670.993955:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918405376 00000100:00100000:2.0:1789601670.993964:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918405376 00000100:00100000:2.0:1789601670.994007:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601670.994015:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918405376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789601670.994034:0:17050:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789601670.994113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601670.994118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789601670.994121:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601670.994128:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789601670.994133:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789601670.994141:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df4f70a0800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601670.994171:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4067b80 x1876532918405760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601670.994200:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405760:0@lo:8:kworker.0 00000400:00000100:0.0:1789601670.994227:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918405760 offset 0 length 520: 4 00000100:00100000:2.0:1789601671.036340:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918405376:12345-0@lo:38:kworker.0 Request processed in 42316us (42646us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789601671.036355:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789601671.036486:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601671.036500:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601671.036504:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405376:0@lo:38:kworker.0 00010000:00010000:1.0:1789601671.177478:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601671.882098:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789601672.202086:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601672.841867:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601672.901715:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601673.222156:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601673.927537:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789601674.247155:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601674.634249:0:17777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601674.634253:0:17777:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789601674.634255:0:17777:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789601674.635988:0:17777:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df4e01b3800 00000020:01000004:2.0:1789601674.636015:0:17777:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789601674.636028:0:17777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789601674.636043:0:17777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8df3c21019c0) 00000020:00000080:2.0:1789601674.636059:0:17777:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789601674.728371:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789601674.729708:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789601674.731879:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789601674.732436:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.740195:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789601674.740797:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.741024:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789601674.741217:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789601674.741439:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.742134:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789601674.742394:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.742929:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.743165:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789601674.743384:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789601674.746198:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.748216:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.749175:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.749435:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.749830:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.750290:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.750734:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.750911:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.751400:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.751809:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.752034:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.752250:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789601674.752619:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.752842:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.753052:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789601674.753312:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.753900:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.754144:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.754632:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.754880:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.755083:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.756301:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.756753:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.758122:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.760317:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.761995:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.763686:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.765979:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.768722:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.769334:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789601674.769837:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789601674.770620:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00080000:01000000:3.0:1789601674.773880:0:17777:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789601674.774127:0:17777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789601674.774139:0:17777:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789601674.774153:0:17777:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f2738 00000020:01000004:3.0:1789601674.774177:0:17777:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789601674.774198:0:17777:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789601674.774202:0:17777:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789601674.774207:0:17777:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789601674.774233:0:17777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789601674.774238:0:17777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789601674.786710:0:17777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789601674.786764:0:17777:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789601674.786768:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789601674.786770:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601674.786772:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601674.786773:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601674.786779:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601674.786781:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601674.786782:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601674.786783:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601674.786784:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601674.786789:0:17777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789601674.786791:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601674.786793:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601674.786793:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601674.786794:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601674.786795:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601674.786796:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601674.786797:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601674.786798:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601674.786799:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601674.786827:0:17777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789601674.786847:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918405888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789601674.786917:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.787039:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9221780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601674.791513:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918405888 00000100:00100000:2.0:1789601674.791538:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918405888 00000100:00100000:2.0:1789601674.791608:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601674.791617:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17777:x1876532918405888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789601674.791651:0:17038:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789601674.791668:0:17038:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789601674.791676:0:17038:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789601674.792294:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17777:x1876532918405888:12345-0@lo:253:mount.lustre.0 Request processed in 676us (5375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601674.792304:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789601674.792404:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918405888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789601674.792418:0:17777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789601674.792422:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789601674.792424:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601674.792426:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601674.792427:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601674.792428:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601674.792429:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601674.792431:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601674.792433:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601674.792434:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789601674.792455:0:17777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df4e01b3800 from lustre-MDT0001 10000000:01000000:3.0:1789601674.792494:0:17777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789601674.792497:0:17777:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789601674.792505:0:17777:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f7638000 local copy 00010000:00010000:3.0:1789601674.792515:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601674.792665:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601674.792702:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.792739:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9905cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601674.792862:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406016 00000100:00100000:2.0:1789601674.792868:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406016 00000100:00100000:2.0:1789601674.792905:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601674.792913:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:17777:x1876532918406016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601674.793125:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+12:17777:x1876532918406016:12345-0@lo:501:mount.lustre.0 Request processed in 212us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601674.793133:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601674.793541:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406016:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789601674.793579:0:17777:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789601674.793602:0:17777:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789601674.793610:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.793621:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601674.793649:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4e01b3800 10000000:01000000:3.0:1789601674.793654:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789601674.793658:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df4f7638000 10000000:01000000:3.0:1789601674.793660:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789601674.793664:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df4f7638000 from 1 10000000:01000000:3.0:1789601674.793666:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789601674.793691:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.793699:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.793708:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601674.793737:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601674.793770:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.793802:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9905cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601674.793912:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406144 00000100:00100000:2.0:1789601674.793918:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406144 00000100:00100000:2.0:1789601674.793953:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601674.793960:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+12:17777:x1876532918406144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601674.793970:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601674.794101:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737ce00/0x74872e3eca9f2746 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f273f expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.794122:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737ce00/0x74872e3eca9f2746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f273f expref: 13 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.794133:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737ce00/0x74872e3eca9f2746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f273f expref: 13 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.794142:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ce00, rc 0) 00000100:00100000:2.0:1789601674.794182:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+13:17777:x1876532918406144:12345-0@lo:101:mount.lustre.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601674.794197:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789601674.794719:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601674.794734:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2746 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.794744:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2746 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601674.794761:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789601674.794778:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2746 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.794785:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678c00/0x74872e3eca9f273f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2746 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601674.794793:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df4e01b3800 10000000:01000000:3.0:1789601674.794798:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789601674.794801:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df4e01b3800 from 1 10000000:01000000:3.0:1789601674.794803:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789601674.794821:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.794828:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.794835:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601674.794857:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601674.794888:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.794920:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9905cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601674.795283:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406272 00000100:00100000:2.0:1789601674.795289:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406272 00000100:00100000:2.0:1789601674.795330:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601674.795338:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+13:17777:x1876532918406272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601674.795348:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601674.795360:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737cc00/0x74872e3eca9f2754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f274d expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.795377:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737cc00/0x74872e3eca9f2754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f274d expref: 14 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.795386:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737cc00/0x74872e3eca9f2754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f274d expref: 14 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601674.795393:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737cc00, rc 0) 00000100:00100000:2.0:1789601674.795437:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+14:17777:x1876532918406272:12345-0@lo:101:mount.lustre.0 Request processed in 98us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601674.795453:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789601674.796201:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601674.796219:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2754 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.796229:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2754 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601674.796245:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789601674.796252:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2754 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.796260:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1679a00/0x74872e3eca9f274d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2754 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601674.796266:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789601674.796271:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601674.796276:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df4e01b3800 10000000:01000000:3.0:1789601674.796279:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789601674.796283:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789601674.796285:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789601674.796308:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.796316:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.796336:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601674.796354:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601674.796395:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.796450:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c9905cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601674.796673:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406400 00000100:00100000:1.0:1789601674.796680:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406400 00000100:00100000:1.0:1789601674.796717:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601674.796726:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+14:17777:x1876532918406400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601674.796736:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601674.796750:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73efe00/0x74872e3eca9f2762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f275b expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601674.796770:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73efe00/0x74872e3eca9f2762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f275b expref: 15 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601674.796779:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73efe00/0x74872e3eca9f2762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f275b expref: 15 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601674.796786:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73efe00, rc 0) 00000100:00100000:1.0:1789601674.796827:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406400:12345-0@lo:101:mount.lustre.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601674.796832:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789601674.796997:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601674.797008:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2762 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601674.797016:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2762 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601674.798550:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789601674.799360:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601674.810041:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789601674.810102:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789601674.810125:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789601674.810141:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789601674.810157:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789601674.810171:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789601674.810184:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789601674.810197:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789601674.810212:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789601674.810233:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789601674.810248:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789601674.810263:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789601674.810276:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789601674.810291:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789601674.810305:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789601674.810318:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789601674.810332:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789601674.810349:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789601674.810365:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789601674.810378:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789601674.810391:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789601674.810402:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789601674.810432:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789601674.810789:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789601674.810798:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789601674.810911:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601674.810988:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601674.811094:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601674.816367:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406528 00000100:00100000:2.0:1789601674.816384:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406528 00000100:00100000:2.0:1789601674.816478:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601674.816489:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601674.816726:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406528:12345-0@lo:501:mount.lustre.0 Request processed in 239us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601674.816735:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789601674.817895:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601674.817954:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601674.818119:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601674.818200:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601674.818243:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406656 00000100:00100000:3.0:1789601674.818250:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406656 00000100:00100000:3.0:1789601674.818330:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789601674.818340:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601674.820769:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406656:12345-0@lo:503:mount.lustre.0 Request processed in 2422us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601674.820783:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789601674.820927:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789601674.821392:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601674.821489:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601674.821543:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601674.821721:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601674.822793:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406784 00000100:00100000:1.0:1789601674.822804:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406784 00000100:00100000:1.0:1789601674.822850:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601674.822860:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601674.824036:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406784:12345-0@lo:502:mount.lustre.0 Request processed in 1174us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601674.824061:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601674.824075:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601674.824337:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789601674.824369:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789601674.824384:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789601674.824397:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789601674.824409:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789601674.824423:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789601674.824435:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789601674.824947:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789601674.824970:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789601674.825000:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789601674.825014:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789601674.825027:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789601674.825040:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789601674.825052:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789601674.825064:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789601674.825076:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789601674.825089:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789601674.825109:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789601674.825124:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789601674.825137:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789601674.825149:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789601674.825174:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789601674.825187:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789601674.825201:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789601674.825212:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789601674.825225:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789601674.825238:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789601674.825252:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789601674.825267:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789601674.825278:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789601674.825289:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789601674.825301:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789601674.825314:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789601674.825327:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789601674.825339:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789601674.825351:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789601674.825364:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789601674.825379:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789601674.825392:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789601674.825404:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789601674.825418:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789601674.825433:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789601674.825452:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789601674.825477:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789601674.825522:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601674.825638:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601674.825675:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601674.825853:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918406912 00000100:00100000:3.0:1789601674.825862:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918406912 00000100:00100000:3.0:1789601674.825910:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789601674.825919:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601674.826048:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918406912:12345-0@lo:502:mount.lustre.0 Request processed in 129us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601674.826055:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601674.826301:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918406912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601674.826364:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789601674.826374:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789601674.828091:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601674.828105:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601674.828108:0:17781:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789601674.828114:0:17781:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789601674.828117:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601674.828131:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8df4fb53cd40) 00000020:00000080:1.0:1789601674.828152:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789601674.828158:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789601674.828237:0:17781:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789601674.828244:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f2770 00000020:00000080:1.0:1789601674.828552:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789601674.828629:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601674.828633:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601674.828634:0:17781:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789601674.828637:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601674.828641:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601674.828642:0:17781:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789601674.828646:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601674.828653:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8df4fb53b380) 00000020:00000080:1.0:1789601674.828665:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789601674.828668:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789601674.828670:0:17781:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789601674.828673:0:17781:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789601674.828678:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789601674.828725:0:17781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4e01b3800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789601674.828746:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8df4fb6f8000) 00000020:00000080:1.0:1789601674.828757:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789601674.828827:0:17781:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789601674.828834:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f2785 00000020:00000080:1.0:1789601674.828931:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789601674.830152:0:17781:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789601674.830164:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x74872e3eca9f278c 00080000:01000000:1.0:1789601674.830174:0:17781:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789601674.830178:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f2793 00010000:00010000:3.0:1789601674.950640:0:17781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000100:00100000:1.0:1789601674.952194:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000001:00000004:3.0:1789601674.952504:0:17781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789601674.953579:0:17781:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789601674.956602:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789601674.956622:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601674.956628:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601674.956631:0:17781:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789601674.956634:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601674.956640:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601674.956642:0:17781:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789601674.956654:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789601674.956660:0:17781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:00000080:2.0:1789601674.956687:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601674.956701:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8df3c2104d40) 00000020:00000080:2.0:1789601674.956724:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789601674.956729:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789601674.956800:0:17781:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789601674.956807:0:17781:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789601674.956814:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f27a1 00010000:00080000:2.0:1789601674.956845:0:17781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4c51a3800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1789601674.958502:0:17781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789601674.966734:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789601674.966749:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789601674.966791:0:17781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789601674.966814:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f27a8 00000100:00080000:3.0:1789601674.966825:0:17781:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601674.966836:0:17781:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df4c51a3800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601674.966873:0:17781:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6680 x1876532918407040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601674.966900:0:17781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789601674.966953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789601674.966957:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789601674.966958:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601674.966962:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1789601674.966966:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789601674.966971:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4d09a9800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601674.966984:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c7800 x1876532918407296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601674.966993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601674.966996:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601674.967005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601674.967008:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789601674.967044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601674.967057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918407424:0@lo:400:kworker.0 00000100:00100000:3.0:1789601674.967120:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601674.967187:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407424 00000100:00100000:3.0:1789601674.967195:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407424 00000100:00100000:3.0:1789601674.967232:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601674.967241:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601674.967307:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918407424:12345-0@lo:400:kworker.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601674.967314:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601674.967356:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df4d09c5f80 x1876532918407424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601674.967369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918407424:0@lo:400:kworker.0 00000020:01000000:3.0:1789601674.967419:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601674.967423:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967425:0:17781:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789601674.967427:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789601674.967430:0:17781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789601674.967432:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601674.967433:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601674.967435:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789601674.967437:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967439:0:17781:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789601674.967441:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601674.967446:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967447:0:17781:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789601674.967457:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789601674.967502:0:17781:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789601674.967516:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601674.967519:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967521:0:17781:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789601674.967524:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789601674.967525:0:17781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789601674.967527:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601674.967528:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601674.967530:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789601674.967532:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967533:0:17781:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789601674.967536:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789601674.967539:0:17781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789601674.967542:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601674.967544:0:17781:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789601674.967546:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789601674.967550:0:17781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:3.0:1789601674.967591:0:17781:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789601674.967594:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789601674.967607:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8df4f7353380) 00000020:00000080:3.0:1789601674.967620:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789601674.967624:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789601674.967694:0:17781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789601674.967701:0:17781:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789601674.967708:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f27b6 00010000:00080000:3.0:1789601674.967735:0:17781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c2390800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789601674.967928:0:17781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1789601674.968449:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407040:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789601674.968508:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601674.968548:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918407296:0@lo:38:kworker.0 00000100:00100000:1.0:1789601674.968603:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601674.968679:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407040 00000100:00100000:2.0:1789601674.968685:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407040 00000100:00100000:2.0:1789601674.968703:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407296 00000100:00100000:2.0:1789601674.968706:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407296 00000100:00100000:2.0:1789601674.968716:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601674.968721:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918407040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789601674.968742:0:17050:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1789601674.968771:0:17050:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f27bd 00000004:00100000:2.0:1789601674.968785:0:17050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789601674.968790:0:17050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789601674.968967:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918407168:0@lo:400:kworker.0 00000100:00100000:0.0:1789601674.969005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789601674.992535:0:17050:0:(import.c:65:import_set_state_nolock()) ffff8df4f8b44800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601674.992649:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918407040:12345-0@lo:38:llog_process_th.0 Request processed in 23923us (24138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601674.992681:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601674.992712:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601674.992719:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918407296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789601674.992765:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918407296:12345-0@lo:38:kworker.0 Request processed in 45us (24161us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789601674.992771:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:01000000:3.0:1789601674.992818:0:17781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789601674.992819:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601674.992828:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789601674.992836:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789601674.992842:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789601674.992844:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4c51a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601674.992856:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601674.992868:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601674.992871:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601674.992874:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789601674.992877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918407296:0@lo:38:kworker.0 00000100:00100000:3.0:1789601674.993126:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918407552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601674.993169:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1789601674.993252:0:17781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789601674.993379:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407552 00000100:00100000:2.0:1789601674.993387:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407552 00000100:00100000:2.0:1789601674.993430:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601674.993445:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876532918407552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601674.993481:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789601674.993527:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876532918407552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601674.993533:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601674.993772:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918407552:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789601674.995298:0:17781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601674.995320:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407168 00000100:00100000:1.0:1789601674.995329:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407168 00000100:00100000:1.0:1789601674.995373:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601674.995383:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+15:3648:x1876532918407168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601674.995477:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+15:3648:x1876532918407168:12345-0@lo:400:kworker.0 Request processed in 96us (26470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601674.995485:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789601674.995583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918407168:0@lo:400:kworker.0 00000040:00080000:2.0:1789601674.995924:0:17781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789601674.996092:0:17781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1789601675.002229:0:17786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789601675.002237:0:17786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789601675.003838:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789601675.003852:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789601675.003919:0:17781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789601675.003944:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f27c4 00000100:00080000:2.0:1789601675.003956:0:17781:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601675.003969:0:17781:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df3c2390800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601675.004018:0:17781:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ad500 x1876532918407680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601675.004080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789601675.004142:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918407680 offset 0 length 520: 4 00000100:00080000:2.0:1789601675.004201:0:17781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789601675.004266:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601675.004271:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601675.004273:0:17781:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789601675.004276:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789601675.004278:0:17781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1789601675.004280:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601675.004282:0:17781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601675.004283:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789601675.004286:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601675.004288:0:17781:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789601675.004290:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789601675.004294:0:17781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789601675.004297:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601675.004305:0:17781:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789601675.004309:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789601675.004313:0:17781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:2.0:1789601675.004336:0:17781:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789601675.004338:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601675.004350:0:17781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8df3c2100000) 00000020:00000080:2.0:1789601675.004362:0:17781:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789601675.004367:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789601675.004449:0:17781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789601675.004456:0:17781:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789601675.004474:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x74872e3eca9f27d2 00010000:00080000:2.0:1789601675.004511:0:17781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4cd0f4000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.148@tcp at head 00000100:00080000:3.0:1789601675.004594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601675.004600:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601675.004603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601675.004606:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789601675.004927:0:17781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789601675.005124:0:17781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789601675.005137:0:17781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789601675.008014:0:17781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601675.008944:0:17781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789601675.009090:0:17781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789601675.010834:0:17788:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789601675.010841:0:17788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789601675.013056:0:17781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789601675.013070:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789601675.013115:0:17781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789601675.013138:0:17781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f27d9 00000100:00080000:3.0:1789601675.013149:0:17781:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601675.013162:0:17781:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789601675.013199:0:17781:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c4a80 x1876532918407808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601675.013231:0:17781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789601675.013333:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789601675.013397:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918407808 offset 0 length 520: 4 00000020:01000000:3.0:1789601675.013594:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.013600:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.013602:0:17781:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789601675.013605:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.013609:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.013610:0:17781:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601675.013613:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601675.013615:0:17781:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789601675.013617:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.013618:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.013620:0:17781:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789601675.013622:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.013624:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.013631:0:17781:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789601675.013635:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789601675.013928:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601675.013933:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601675.013935:0:17781:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789601675.013939:0:17781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1789601675.014013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601675.014017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601675.014020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601675.014022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789601675.014184:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789601675.014210:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789601675.014226:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2762 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.014236:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1679200/0x74872e3eca9f275b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2762 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601675.014241:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4e01b3800 from 1 10000000:01000000:1.0:1789601675.014243:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601675.014280:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.014288:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.014298:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601675.014316:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918407936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601675.014367:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601675.014401:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601675.014787:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918407936 00000100:00100000:2.0:1789601675.014795:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918407936 00000100:00100000:2.0:1789601675.014832:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789601675.014841:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+15:17777:x1876532918407936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601675.014854:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601675.014867:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f27e0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.014889:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 16 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.014913:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 16 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.014922:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ca00, rc 0) 00000100:00100000:2.0:1789601675.015021:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+16:17777:x1876532918407936:12345-0@lo:101:mount.lustre.0 Request processed in 180us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.015028:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789601675.015384:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918407936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601675.015400:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.015409:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601675.016138:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408064:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789601675.016187:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.016278:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9221780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601675.016528:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408064 00000100:00100000:2.0:1789601675.016535:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408064 00000100:00100000:2.0:1789601675.016758:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601675.016768:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+16:17777:x1876532918408064:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789601675.016789:0:17039:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789601675.016810:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789601675.016813:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789601675.016915:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+16:17777:x1876532918408064:12345-0@lo:256:mount.lustre.0 Request processed in 150us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.016923:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601675.017000:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408064:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789601675.017671:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601675.017690:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.017700:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601675.017708:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4e01b3800 from 1 10000000:01000000:1.0:1789601675.017710:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601675.017741:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.017750:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.017759:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601675.017834:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601675.017872:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.018880:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408192 00000100:00100000:3.0:1789601675.018889:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408192 00000100:00100000:0.0:1789601675.018913:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.018943:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789601675.018952:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+16:17777:x1876532918408192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601675.018964:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601675.018981:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f27ee expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.019006:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.019017:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.019026:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678a00, rc 0) 00000100:00100000:3.0:1789601675.019078:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408192:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.019097:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601675.019395:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601675.019425:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601675.019435:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601675.019636:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601675.019778:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601675.019816:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.019848:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.019875:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408320 00000100:00100000:3.0:1789601675.019882:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408320 00000100:00100000:3.0:1789601675.019952:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789601675.019961:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601675.020055:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408320:12345-0@lo:501:mount.lustre.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.020061:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789601675.020087:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601675.020113:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601675.020151:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.020177:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601675.020293:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408448 00000100:00100000:2.0:1789601675.020298:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408448 00000100:00100000:2.0:1789601675.020378:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601675.020387:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601675.020499:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408448:12345-0@lo:503:mount.lustre.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.020505:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601675.020595:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789601675.020969:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601675.021054:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601675.021091:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.022371:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601675.022879:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408576 00000100:00100000:1.0:1789601675.022888:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408576 00000100:00100000:3.0:1789601675.023136:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789601675.023146:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.023313:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408576:12345-0@lo:502:mount.lustre.0 Request processed in 169us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.023320:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789601675.023425:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601675.023937:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789601675.023972:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789601675.023999:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789601675.024012:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789601675.024027:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789601675.024039:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789601675.024069:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789601675.024083:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789601675.024095:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789601675.024107:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789601675.024118:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789601675.024152:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601675.024198:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.024912:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601675.025133:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408704 00000100:00100000:2.0:1789601675.025141:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408704 00000100:00100000:2.0:1789601675.025192:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601675.025201:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601675.025373:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408704:12345-0@lo:502:mount.lustre.0 Request processed in 172us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.025381:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789601675.027208:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601675.027305:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789601675.027319:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789601675.028180:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.028190:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028193:0:17790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789601675.028199:0:17790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4e01b3800 00000020:00000080:3.0:1789601675.028202:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601675.028210:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.028213:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028214:0:17790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789601675.028217:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.028219:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028221:0:17790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789601675.028224:0:17790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4e01b3800 00000020:00000080:3.0:1789601675.028226:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601675.028284:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.028288:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028298:0:17790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789601675.028301:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.028304:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028306:0:17790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601675.028309:0:17790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4e01b3800 00000020:00000080:3.0:1789601675.028312:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601675.028331:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.028334:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028335:0:17790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601675.028337:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601675.028339:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028341:0:17790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789601675.028344:0:17790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4e01b3800 00000020:00000080:3.0:1789601675.028346:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601675.028366:0:17790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601675.028368:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601675.028370:0:17790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789601675.028373:0:17790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789601675.028774:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789601675.028806:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601675.028822:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.028836:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601675.028886:0:17777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789601675.028889:0:17777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4e01b3800 10000000:01000000:1.0:1789601675.028892:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4e01b3800 10000000:01000000:1.0:1789601675.028896:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601675.028901:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4e01b3800 from 1 10000000:01000000:1.0:1789601675.028904:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601675.028937:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.028946:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.028957:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601675.029060:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601675.029127:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601675.029177:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c20bc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.029238:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408832 00000100:00100000:3.0:1789601675.029245:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408832 00000100:00100000:3.0:1789601675.029292:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789601675.029301:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17777:x1876532918408832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601675.029313:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601675.029325:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1678800/0x74872e3eca9f2803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f27fc expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.029346:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1678800/0x74872e3eca9f2803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f27fc expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.029355:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1678800/0x74872e3eca9f2803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f27fc expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.029374:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678800, rc 0) 00000100:00100000:3.0:1789601675.029423:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918408832:12345-0@lo:101:mount.lustre.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.029429:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789601675.029487:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601675.029501:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2803 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.029510:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2803 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601675.032804:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789601675.033116:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601675.033337:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789601675.033365:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789601675.033382:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789601675.033398:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789601675.033412:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789601675.033426:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789601675.033456:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789601675.033486:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789601675.033502:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789601675.033516:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789601675.033541:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789601675.033598:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789601675.033628:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789601675.033644:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789601675.038143:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789601675.038207:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789601675.038223:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789601675.038236:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789601675.038250:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789601675.038264:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789601675.038278:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789601675.038290:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789601675.038302:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789601675.038316:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789601675.038328:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789601675.038339:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789601675.038350:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1789601675.039097:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1789601675.039154:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1789601675.039161:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789601675.039275:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601675.039345:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.039480:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601675.053899:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918408960 00000100:00100000:1.0:1789601675.053917:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918408960 00000100:00100000:2.0:1789601675.054120:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789601675.054131:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918408960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601675.054342:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918408960:12345-0@lo:501:mount.lustre.0 Request processed in 213us (14995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.054350:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789601675.055807:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918408960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601675.055868:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601675.055935:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601675.056146:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409088 00000100:00100000:1.0:1789601675.056153:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409088 00000100:00100000:1.0:1789601675.056192:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789601675.056201:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601675.056303:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409088:12345-0@lo:503:mount.lustre.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601675.056311:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789601675.057420:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.058477:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601675.061621:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601675.061737:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.061825:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.061873:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.061901:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409216 00000100:00100000:3.0:1789601675.061915:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409216 00000100:00100000:3.0:1789601675.061964:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601675.064095:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.064265:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409216:12345-0@lo:502:mount.lustre.0 Request processed in 2291us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.064275:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601675.064365:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601675.064620:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789601675.064650:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789601675.064664:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789601675.064677:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789601675.064690:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789601675.064703:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789601675.064717:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789601675.064728:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789601675.064739:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789601675.064749:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789601675.064760:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789601675.064771:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789601675.064793:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789601675.064805:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789601675.064815:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789601675.064826:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789601675.064836:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789601675.064847:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789601675.064857:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789601675.064867:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789601675.064878:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789601675.064888:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789601675.064898:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789601675.064918:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789601675.064928:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789601675.064939:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789601675.064950:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789601675.064960:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789601675.070650:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789601675.070712:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789601675.070729:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789601675.070743:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789601675.070757:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789601675.070770:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789601675.070783:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789601675.070795:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789601675.070805:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789601675.070816:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789601675.070827:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789601675.070838:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789601675.070853:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789601675.070867:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789601675.070881:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789601675.070896:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789601675.070929:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789601675.070947:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789601675.070962:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789601675.070977:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789601675.071038:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.071117:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.071167:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.071196:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409344 00000100:00100000:3.0:1789601675.071204:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409344 00000100:00100000:3.0:1789601675.071259:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789601675.071268:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.071387:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409344:12345-0@lo:502:mount.lustre.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.071395:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789601675.071445:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601675.071653:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789601675.071675:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789601675.071696:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.071729:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.071746:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.071761:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409472 00000100:00100000:3.0:1789601675.071765:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409472 00000100:00100000:3.0:1789601675.071786:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789601675.071793:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601675.071858:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409472:12345-0@lo:502:mount.lustre.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601675.071864:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789601675.071903:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601675.071941:0:17777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789601675.071948:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789601675.073222:0:17794:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789601675.073238:0:17794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8df4fb6fcd40) 00000020:00000080:1.0:1789601675.073259:0:17794:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789601675.073343:0:17794:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4e01b3800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789601675.073348:0:17794:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4e01b3800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789601675.073350:0:17794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4e01b3800 3 00010000:00080000:1.0:1789601675.073392:0:17794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4f891b800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789601675.076216:0:17794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789601675.078203:0:17794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789601675.078253:0:17794:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789601675.078271:0:17794:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x74872e3eca9f2811 00000100:00080000:1.0:1789601675.078282:0:17794:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601675.078294:0:17794:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df4f891b800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601675.078330:0:17794:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359f800 x1876532918409600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601675.079110:0:17794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789601675.079363:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601675.079369:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601675.079372:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601675.079375:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789601675.089864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918409600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601675.089942:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.090868:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409600 00000100:00100000:0.0:1789601675.090878:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409600 00000100:00100000:0.0:1789601675.090914:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601675.090931:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918409600:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789601675.090959:0:17045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789601675.091161:0:17045:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x74872e3eca9f2818 00000004:00100000:0.0:1789601675.091176:0:17045:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789601675.091211:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8df3c23dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601675.091280:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876532918409600:12345-0@lo:38:llog_process_th.0 Request processed in 349us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601675.091289:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789601675.091331:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df3c359f800 x1876532918409600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601675.091342:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601675.091349:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789601675.091417:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789601675.091423:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789601675.091425:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f891b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601675.091431:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876532918409600:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789601675.094173:0:17794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1789601675.095604:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789601675.095656:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601675.095680:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2803 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.095692:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73eec00/0x74872e3eca9f27fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2803 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789601675.095751:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789601675.095753:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601675.095755:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601675.095756:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601675.095757:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601675.095758:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601675.095760:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601675.095762:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601675.095763:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789601675.095767:0:17777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789601675.095770:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601675.095771:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601675.095772:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601675.095773:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601675.095774:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601675.095775:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601675.095776:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601675.095776:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601675.095777:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789601675.095806:0:17777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789601675.095828:0:17777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789601675.095897:0:17777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601675.095931:0:17777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.095960:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409728 00000100:00100000:3.0:1789601675.095966:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409728 00000100:00100000:3.0:1789601675.099824:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789601675.099838:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789601675.099893:0:17039:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789601675.099906:0:17039:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789601675.105250:0:17025:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789601675.105288:0:17039:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789601675.105299:0:17039:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789601675.106116:0:17061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789601675.106124:0:17061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789601675.106149:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.106168:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f271c expref: 18 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.106176:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.106184:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.106223:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.106239:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601675.106252:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918409856:0@lo:104: 00000100:00100000:3.0:1789601675.106313:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601675.107545:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 18 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.107577:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 18 pid: 17038 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601675.107603:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918409984:0@lo:104: 00000100:00100000:3.0:1789601675.107648:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601675.107789:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17777:x1876532918409728:12345-0@lo:253:mount.lustre.0 Request processed in 7952us (11889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.107801:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789601675.112204:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409856 00000100:00100000:1.0:1789601675.112221:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409856 00000100:00100000:1.0:1789601675.112274:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918409984 00000100:00100000:1.0:1789601675.112278:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918409984 00000100:00100000:1.0:1789601675.112296:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601675.112306:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918409856:12345-0@lo:104: 00010000:00010000:1.0:1789601675.112324:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601675.114628:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601675.114777:0:17777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:17777:1876532918409728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789601675.114792:0:17777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789601675.114795:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789601675.114797:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789601675.114798:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601675.114800:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601675.114801:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601675.114802:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601675.114804:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601675.114805:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601675.114807:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789601675.114822:0:17777:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789601675.115335:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918409856:0@lo:104: 00010000:00010000:1.0:1789601675.115546:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601675.115569:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918409856:12345-0@lo:104: Request processed in 3250us (9242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601675.115582:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601675.115630:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601675.115641:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918409984:12345-0@lo:104: 00010000:00010000:1.0:1789601675.115666:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601675.117847:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918409984:0@lo:104: 00010000:00010000:0.0:1789601675.117884:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118212:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601675.118221:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118229:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601675.118232:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118241:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601675.118247:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601675.118272:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601675.118516:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601675.118526:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918409984:12345-0@lo:104: Request processed in 2888us (10876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601675.118545:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789601675.118609:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601675.118786:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118795:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601675.118818:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118825:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef600/0x74872e3eca9f27e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27e7 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.118847:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601675.118849:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601675.118851:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601675.118864:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918410112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601675.118924:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601675.119124:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410112 00000100:00100000:2.0:1789601675.119132:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410112 00010000:00010000:2.0:1789601675.119160:0:17030:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601675.119223:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601675.119231:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+18:3647:x1876532918410112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601675.119245:0:17030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601675.119250:0:17030:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.119260:0:17030:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.119287:0:17030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f27e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f27e0 expref: 18 pid: 17037 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601675.119300:0:17030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601675.119335:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+17:3647:x1876532918410112:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601675.119342:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789601675.123389:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601675.123402:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.123415:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467600 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601675.123419:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.123431:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601675.123438:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601675.123443:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601675.123507:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.123515:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601675.123531:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601675.123538:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3467600/0x74872e3eca9f271c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2723 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601675.123544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918410112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601675.123571:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601675.123573:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601675.123575:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601675.123583:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789601675.123589:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601675.123590:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601675.123592:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918410240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601675.123899:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601675.124069:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410240 00000100:00100000:1.0:1789601675.124077:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410240 00010000:00010000:1.0:1789601675.124104:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 17 pid: 17038 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601675.124132:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601675.124147:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+17:3647:x1876532918410240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601675.124160:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601675.124166:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 17 pid: 17038 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124176:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 17 pid: 17038 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124191:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f271c expref: 17 pid: 17038 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124204:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124212:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789601675.124225:0:17032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018102256s 00010000:00010000:1.0:1789601675.124230:0:17032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124236:0:17032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124243:0:17032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124248:0:17032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124253:0:17032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601675.124262:0:17032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124269:0:17032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124284:0:17032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601675.124295:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601675.124336:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+16:3647:x1876532918410240:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601675.124343:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601675.124549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918410240:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1789601675.126950:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789601675.127149:0:17803:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789601675.127153:0:17803:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789601675.127948:0:17804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789601675.128031:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00010000:00010000:0.0:1789601675.128522:0:17061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601675.128536:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601675.128543:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f281f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601675.128972:0:17804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601675.129202:0:17805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129275:0:17805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.129315:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410368 00000100:00100000:0.0:1789601675.129323:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410368 00000100:00100000:0.0:1789601675.129368:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601675.129377:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129448:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601675.129455:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601675.129486:0:17805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601675.129512:0:17805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789601675.129540:0:17805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789601675.129586:0:17805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129616:0:17805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.129634:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410496 00000100:00100000:0.0:1789601675.129637:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410496 00000100:00100000:0.0:1789601675.129656:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601675.129662:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129748:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601675.129755:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601675.129770:0:17805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601675.129781:0:17805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129823:0:17805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17805:1876532918410624:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.129852:0:17805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.129871:0:17805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601675.130092:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410624 00000100:00100000:1.0:1789601675.130098:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410624 00000040:01000000:3.0:1789601675.130117:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789601675.130133:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601675.130141:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1876532918410624:12345-0@lo:900:lod0001_rec0000.0 00000040:00080000:3.0:1789601675.130165:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601675.130186:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1876532918410624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601675.130193:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789601675.130508:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df3c4066a00 x1876532918410624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601691 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601675.130519:0:17805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17805:1876532918410624:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.130572:0:17805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.130597:0:17805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601675.130614:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410752 00000100:00100000:0.0:1789601675.130617:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410752 00000100:00100000:0.0:1789601675.130637:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601675.130643:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789601675.130687:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1876532918410752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601675.130693:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601675.130710:0:17805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f74b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601675.130723:0:17805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1876532918410752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789601675.130758:0:17805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601675.132936:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789601675.133009:0:17805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1789601675.133725:0:17777:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789601675.133738:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789601675.133833:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601675.135325:0:17777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789601675.135698:0:17804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789601675.135748:0:17804:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789601675.135752:0:17804:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1789601675.136059:0:17777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789601675.136097:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789601675.136219:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789601675.136863:0:17777:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789601675.141254:0:17777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789601675.148626:0:17777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789601675.148668:0:17777:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa27c80dd3988 00100000:10000000:3.0:1789601675.148687:0:17777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789601675.149489:0:17777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789601675.149523:0:17777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789601675.149541:0:17777:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789601675.149592:0:17777:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789601675.151296:0:17777:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789601675.151744:0:17777:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601675.269805:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601675.973719:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000040:00080000:2.0:1789601676.166900:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601676.293752:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601676.998471:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 10000000:01000000:3.0:1789601677.125655:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601677.125665:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4e01b3800 from 8 10000000:01000000:3.0:1789601677.125671:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601677.125714:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.125727:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.125740:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601677.125765:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918410880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601677.125825:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601677.125935:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d92213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601677.126055:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918410880 00000100:00100000:0.0:1789601677.126063:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918410880 00000100:00100000:0.0:1789601677.126929:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601677.126942:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+16:17042:x1876532918410880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601677.126958:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601677.126985:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2826 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601677.127021:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 17 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601677.127032:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 17 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601677.127042:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466200, rc 0) 00000100:00100000:0.0:1789601677.127103:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918410880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601677.127111:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789601677.127186:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918410880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601677.127214:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601677.127224:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601677.127306:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601677.127352:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601677.127896:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c29a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601677.127933:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411008 00000100:00100000:3.0:1789601677.127940:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411008 00000100:00100000:3.0:1789601677.127978:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789601677.127986:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918411008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789601677.128001:0:17037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789601677.128017:0:17037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789601677.128020:0:17037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789601677.128100:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918411008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601677.128111:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789601677.128145:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789601677.128189:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601677.128208:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128219:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601677.128229:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601677.128232:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df3c41ab800 from 8 10000000:01000000:3.0:1789601677.128235:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601677.128255:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128263:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128271:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601677.128762:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601677.128794:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601677.128815:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d92219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601677.128827:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411136 00000100:00100000:3.0:1789601677.128832:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411136 00000100:00100000:3.0:1789601677.128852:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601677.128858:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918411136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601677.128872:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601677.128883:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2834 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128900:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 18 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128910:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 18 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.128918:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679600, rc 0) 00000100:00100000:3.0:1789601677.128947:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918411136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601677.128953:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601677.129141:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601677.129154:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.129164:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601677.129271:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789601677.129428:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601677.129498:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f3950780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601677.129551:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411264 00000100:00100000:2.0:1789601677.129762:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411264 00000100:00100000:2.0:1789601677.129798:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601677.129806:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918411264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789601677.129819:0:17037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601677.129832:0:17037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601677.129835:0:17037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789601677.129899:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918411264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601677.129906:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789601677.130041:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918411264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789601677.130079:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601677.130086:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601677.130100:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601677.190518:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601677.318579:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601678.027722:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:2.0:1789601678.341815:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601679.048698:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00010000:00010000:3.0:1789601679.374706:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601679.648376:0:18048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789601680.069703:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 0 seconds 00000100:00080000:0.0:1789601680.199504:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789601680.199511:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789601680.199515:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601680.199532:0:13926:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df4d09a9800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601680.199553:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4064000 x1876532918411648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601680.199609:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601680.199612:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601680.199616:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601680.199618:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601680.199652:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601680.199656:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601680.199668:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601680.199674:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789601680.199675:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918411776:0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.199702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918411392:0@lo:400:kworker.0 00000100:00100000:3.0:1789601680.199777:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918411520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601680.199870:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601680.199914:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.199938:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601680.199980:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412032 00000100:00100000:0.0:1789601680.199987:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412032 00000100:00100000:0.0:1789601680.200028:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601680.200037:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918412032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.200087:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918412032:12345-0@lo:400:kworker.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601680.200094:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789601680.200127:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df3c4065500 x1876532918412032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601680.200138:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.201754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918411904:0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.201811:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601680.201853:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411904 00000100:00100000:0.0:1789601680.201859:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411904 00000100:00100000:0.0:1789601680.201904:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601680.201913:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918411904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.202340:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918411904:12345-0@lo:400:kworker.0 Request processed in 427us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601680.202355:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601680.202543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918411904:0@lo:400:kworker.0 00000100:00100000:3.0:1789601680.204002:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601680.204102:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601680.204155:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411392 00000100:00100000:2.0:1789601680.204162:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411392 00000100:00100000:2.0:1789601680.204200:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601680.204209:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:3645:x1876532918411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601680.204338:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411520 00000100:00100000:3.0:1789601680.204342:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411520 00000100:00100000:0.0:1789601680.204497:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411776 00000100:00100000:0.0:1789601680.204503:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411776 00000100:00100000:0.0:1789601680.204533:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601680.204540:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918411776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601680.204609:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918411776:12345-0@lo:400:kworker.0 Request processed in 69us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601680.204616:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601680.204712:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:3645:x1876532918411392:12345-0@lo:400:kworker.0 Request processed in 504us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601680.204732:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601680.204780:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918411648:0@lo:38:kworker.0 00000100:00100000:2.0:1789601680.204816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789601680.204857:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df3c4067480 x1876532918411776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601680.204871:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918411776:0@lo:400:kworker.0 00000100:00100000:3.0:1789601680.204953:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601680.204964:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918411520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789601680.204992:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789601680.205115:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918411520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.205122:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601680.205138:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918411648 00000100:00100000:3.0:1789601680.205142:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918411648 00000100:00100000:3.0:1789601680.205155:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789601680.205160:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876532918411648:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789601680.205181:0:17050:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1789601680.205217:0:17050:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f2842 00000004:00100000:3.0:1789601680.205229:0:17050:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789601680.205248:0:17050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789601680.205335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918411520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601680.205468:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918411392:0@lo:400:kworker.0 00000100:00080000:3.0:1789601680.218679:0:17050:0:(import.c:65:import_set_state_nolock()) ffff8df4f7341000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601680.218884:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918411648:12345-0@lo:38:kworker.0 Request processed in 13720us (14065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.218894:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789601680.219003:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789601680.219024:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789601680.219029:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789601680.219032:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d09a9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789601680.219050:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002763690c): req@ffff8df3c36aea00 x1876532918404480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601680.219069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918411648:0@lo:38:kworker.0 00000100:00100000:0.0:1789601680.219131:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601680.219162:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f9e56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601680.219448:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918404480 00000100:00100000:3.0:1789601680.219455:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918404480 00000100:00100000:3.0:1789601680.219495:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601680.219506:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918404480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789601680.219602:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918404480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.219610:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601680.219640:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17087:1876532918404480:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789601680.219670:0:17087:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789601680.219702:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17087:1876532918412288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789601680.219813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918412160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601680.219838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601680.220075:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601680.220088:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601680.220182:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412160 00000100:00100000:3.0:1789601680.220186:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412160 00000100:00100000:3.0:1789601680.220204:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412288 00000100:00100000:3.0:1789601680.220206:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412288 00000100:00100000:3.0:1789601680.220216:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601680.220221:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1876532918412160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601680.220242:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789601680.220327:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1876532918412160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.220333:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601680.220347:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601680.220353:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918412288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789601680.220485:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918412288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.220491:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601680.220518:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17087:1876532918412288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789601680.220606:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17087:1876532918412416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789601680.220631:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601680.220646:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4fecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601680.220657:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412416 00000100:00100000:3.0:1789601680.220661:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412416 00000100:00100000:3.0:1789601680.220676:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601680.220681:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918412416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789601680.220719:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1876532918412416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 37us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601680.220725:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601680.220764:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17087:1876532918412416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789601680.220800:0:17087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601680.237231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918412160:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789601680.239277:0:17087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789601680.239361:0:17087:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1789601680.239376:0:17087:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789601680.391504:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789601680.650446:0:18100:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789601680.650666:0:18100:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789601681.415341:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601681.666732:0:18150:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601681.667408:0:18150:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789601682.054190:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601682.442772:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789601682.722823:0:18198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccf9ee590 20000000:00000080:1.0:1789601682.722843:0:18198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df4c350b000 uarg=0000000000000000 20000000:01000000:1.0:1789601682.722883:0:18198:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789601682.722891:0:18198:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789601682.722896:0:18198:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789601682.724252:0:18199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789601682.724342:0:18198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789601682.735910:0:18198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789601682.736196:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736230:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736238:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736245:0:18198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736715:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736731:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 17 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601682.736744:0:18198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18198:1876532918412544:0@lo:104: 00000100:00100000:3.0:1789601682.736809:0:18198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601682.736867:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.736876:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601682.736884:0:18198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18198:1876532918412672:0@lo:104: 00000100:00100000:3.0:1789601682.736906:0:18198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601682.737029:0:18198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8aa3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601682.739086:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412544 00000100:00100000:1.0:1789601682.739099:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412544 00000100:00100000:1.0:1789601682.739147:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412672 00000100:00100000:1.0:1789601682.739150:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412672 00000100:00100000:1.0:1789601682.739167:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601682.739177:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:18198:x1876532918412544:12345-0@lo:104: 00010000:00010000:1.0:1789601682.739193:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739309:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601682.739315:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:18198:x1876532918412544:12345-0@lo:104: Request processed in 140us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601682.739321:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601682.739337:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601682.739343:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:18198:x1876532918412672:12345-0@lo:104: 00010000:00010000:1.0:1789601682.739350:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739391:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601682.739396:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:18198:x1876532918412672:12345-0@lo:104: Request processed in 54us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601682.739401:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789601682.739433:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601682.739439:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739447:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601682.739451:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739473:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601682.739480:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601682.739485:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601682.739519:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739525:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601682.739544:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739552:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef000/0x74872e3eca9f27ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f27f5 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739588:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601682.739591:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739596:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678400 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:1.0:1789601682.739600:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739605:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601682.739613:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601682.739625:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601682.739640:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739645:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601682.739651:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739656:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f26eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f26f2 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601682.739669:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601682.739671:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601682.739672:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601682.741073:0:18198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18198:1876532918412544:0@lo:104: 00000100:00100000:3.0:1789601682.741086:0:18198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18198:1876532918412672:0@lo:104: 00010000:00010000:3.0:1789601682.741115:0:18198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741230:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601682.741246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918412800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601682.741302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601682.741349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601682.741355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918412928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601682.741375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601682.741432:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412800 00000100:00100000:2.0:1789601682.741438:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412800 00010000:00010000:2.0:1789601682.741465:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 18 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601682.741488:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918412928 00000100:00100000:2.0:1789601682.741491:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918412928 00010000:00010000:2.0:1789601682.741502:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 19 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601682.741517:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601682.741525:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+19:3647:x1876532918412800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601682.741537:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601682.741542:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 19 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741581:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 19 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741597:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1678a00/0x74872e3eca9f27f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f27ee expref: 19 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741610:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601682.741644:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+18:3647:x1876532918412800:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601682.741651:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601682.741666:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601682.741671:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+17:3647:x1876532918412928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601682.741679:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601682.741683:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741691:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741700:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f26f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f26eb expref: 17 pid: 17037 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741711:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741720:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741852:0:17031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741866:0:17031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741872:0:17031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741878:0:17031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741884:0:17031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601682.741888:0:17031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741897:0:17031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741910:0:17031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601682.741920:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601682.741945:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+16:3647:x1876532918412928:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601682.741953:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601682.741985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918412928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601682.741994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918412800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601682.742084:0:18198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.742092:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601682.742098:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f2849 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601683.477079:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789601684.486504:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601684.486512:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4e01b3800 from 13 10000000:01000000:1.0:1789601684.486517:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601684.486591:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.486603:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.486614:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601684.486639:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.486708:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.486748:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601684.486864:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413056 00000100:00100000:0.0:1789601684.486874:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413056 00000100:00100000:0.0:1789601684.486930:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789601684.486940:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+16:17042:x1876532918413056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601684.486953:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601684.486966:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2850 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601684.486989:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 17 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601684.486999:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 17 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601684.487008:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467400, rc 0) 00000100:00100000:0.0:1789601684.487789:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 848us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601684.487799:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:3.0:1789601684.488074:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601684.488349:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601684.488448:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.488459:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601684.488533:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.488597:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.488627:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601684.489099:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413184 00000100:00100000:2.0:1789601684.489106:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413184 00000100:00100000:2.0:1789601684.489157:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789601684.489176:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601684.489305:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601684.489313:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789601684.489488:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.489519:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.489582:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.489606:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601684.489730:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413312 00000100:00100000:3.0:1789601684.489734:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413312 00000100:00100000:3.0:1789601684.489766:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601684.489772:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601684.489861:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601684.489869:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789601684.489952:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789601684.493545:0:18268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789601684.494777:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789601684.494805:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601684.494817:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.494829:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601684.494840:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601684.494842:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df3c41ab800 from 13 10000000:01000000:1.0:1789601684.494845:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601684.494884:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.494906:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.494918:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601684.494955:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.495028:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.495077:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601684.495127:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413440 00000100:00100000:3.0:1789601684.495136:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413440 00000100:00100000:3.0:1789601684.495186:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601684.495195:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+17:17042:x1876532918413440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601684.495207:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601684.495219:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f285e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601684.495242:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f285e expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601684.495263:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f285e expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601684.495272:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1679000, rc 0) 00000100:00100000:3.0:1789601684.495316:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918413440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601684.495323:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601684.496602:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601684.496624:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.496635:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601684.496708:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.496754:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.496786:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601684.496807:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413568 00000100:00100000:1.0:1789601684.496812:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413568 00000100:00100000:1.0:1789601684.496845:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601684.496853:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918413568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.496965:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918413568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601684.496972:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601684.497022:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.497047:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.497086:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601684.497101:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601684.497111:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413696 00000100:00100000:1.0:1789601684.497114:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413696 00000100:00100000:1.0:1789601684.497133:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601684.497138:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918413696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601684.497206:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:17042:x1876532918413696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601684.497213:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601684.497256:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918413696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789601684.497951:0:18269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789601684.498010:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789601684.498026:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601684.498035:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601684.498044:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601685.318331:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601685.318353:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918413824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601685.318435:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601685.318573:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601675/real 1789601675] req@ffff8df4d09c4a80 x1876532918407808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318597:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df4d09c4a80 x1876532918407808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318607:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601675/real 1789601675] req@ffff8df3c36ad500 x1876532918407680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318617:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c36ad500 x1876532918407680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318641:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601670/real 1789601670] req@ffff8df3c4067b80 x1876532918405760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318654:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c4067b80 x1876532918405760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318663:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601670/real 1789601670] req@ffff8df3c4065880 x1876532918405504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601685.318674:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c4065880 x1876532918405504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601685.318687:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601685.318695:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601685.318699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407808:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789601685.318705:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2390800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601685.318709:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601685.318712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918407680:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789601685.318716:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601685.318720:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601685.318722:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405760:0@lo:8:kworker.0 00000100:00080000:0.0:1789601685.318727:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601685.318730:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601685.318733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918405504:0@lo:8:kworker.0 00000100:00080000:2.0:1789601685.320494:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601685.320500:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789601685.320503:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601685.320510:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789601685.320516:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789601685.320526:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df4f70a0800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601685.320545:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36aed80 x1876532918414208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601685.320584:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601685.320587:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601685.320589:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601685.320593:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789601685.320595:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789601685.320600:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601685.320611:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36adc00 x1876532918414336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601685.320627:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601685.320640:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789601685.320642:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df3c2390800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601685.320646:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789601685.320648:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789601685.320654:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df3c2390800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601685.320665:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36af800 x1876532918414592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601685.320673:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601685.320676:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601685.320677:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601685.320680:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789601685.320682:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789601685.320685:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601685.320696:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ad500 x1876532918414720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601685.320727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918414080:0@lo:400:kworker.0 00000100:00100000:2.0:1789601685.320781:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601685.320814:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601685.320820:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918414464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601685.320842:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601685.320872:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413824 00000100:00100000:2.0:1789601685.320879:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413824 00000100:00100000:2.0:1789601685.320991:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918414080 00000100:00100000:2.0:1789601685.320995:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918414080 00000100:00100000:2.0:1789601685.321012:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601685.321020:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918413824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601685.321059:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789601685.321095:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918413824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601685.321102:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601685.321120:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601685.321200:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918414080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601685.321317:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918414080:12345-0@lo:400:kworker.0 Request processed in 119us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601685.321324:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601685.321347:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918414464 00000100:00100000:2.0:1789601685.321351:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918414464 00000100:00100000:2.0:1789601685.321375:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601685.321382:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918414464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601685.321422:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918414464:12345-0@lo:400:kworker.0 Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601685.321428:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789601685.321465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df3c36ac000 x1876532918414464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601685.321478:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918414464:0@lo:400:kworker.0 00000100:00100000:2.0:1789601685.321490:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918414080:0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.321820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918413952:0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.321858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601685.321902:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918413824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601685.321928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601685.321935:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.321969:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601685.322003:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918413952 00000100:00100000:1.0:1789601685.322007:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918413952 00000100:00100000:1.0:1789601685.322034:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601685.322040:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:3646:x1876532918413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.322071:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:3646:x1876532918413952:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601685.322078:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601685.322107:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918414848 00000100:00100000:1.0:1789601685.322110:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918414848 00000100:00100000:1.0:1789601685.322143:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601685.322149:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.322176:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918414848:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601685.322182:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789601685.322208:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df3c36aea00 x1876532918414848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601685.322422:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601685.322437:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918413952:0@lo:400:kworker.0 00000100:00100000:0.0:1789601685.324507:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918414208:0@lo:8:kworker.0 00000400:00000100:0.0:1789601685.324593:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918414208 offset 0 length 520: 4 00000100:00100000:0.0:1789601685.324632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918414336:0@lo:8:kworker.0 00000400:00000100:0.0:1789601685.324655:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918414336 offset 0 length 520: 4 00000100:00100000:0.0:1789601685.324667:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918414592:0@lo:8:kworker.0 00000400:00000100:0.0:1789601685.324681:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918414592 offset 0 length 520: 4 00000100:00100000:0.0:1789601685.324691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918414720:0@lo:8:kworker.0 00000400:00000100:0.0:1789601685.324705:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532918414720 offset 0 length 520: 4 00000100:00100000:3.0:1789601685.325063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601685.325073:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918414976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789601685.325108:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601685.325151:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918414976 00000100:00100000:3.0:1789601685.325157:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918414976 00000100:00100000:3.0:1789601685.325191:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601685.325199:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918414976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789601685.325439:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789601685.325492:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876532918414976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 293us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601685.325499:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601685.325603:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918414976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789601685.509728:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789601685.833032:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789601686.536767:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601687.433934:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601687.559790:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601688.589015:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789601689.297241:0:18547:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789601689.297245:0:18547:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789601689.297246:0:18547:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789601689.297353:0:18547:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df4c363f000 00000020:01000004:0.0:1789601689.297376:0:18547:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789601689.297388:0:18547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789601689.297402:0:18547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df4f3720000) 00000020:00000080:0.0:1789601689.297490:0:18547:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789601689.360550:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789601689.364136:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789601689.364501:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789601689.364916:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789601689.365121:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789601689.365319:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789601689.365965:0:18547:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1789601689.367823:0:18547:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789601689.368072:0:18547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789601689.368085:0:18547:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789601689.368097:0:18547:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74872e3eca9f2873 00000020:01000004:1.0:1789601689.368104:0:18547:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789601689.368125:0:18547:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789601689.368128:0:18547:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789601689.368134:0:18547:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789601689.368139:0:18547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789601689.368150:0:18547:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df4fb6fb380) 00000020:00000080:1.0:1789601689.368161:0:18547:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789601689.377654:0:18547:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601689.377851:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789601689.377857:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789601689.380401:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789601689.381401:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789601689.382852:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789601689.382861:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789601689.385769:0:18547:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601689.385956:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601689.385966:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789601689.387547:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789601689.387581:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789601689.416802:0:18547:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601689.417033:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601689.417040:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789601689.419797:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789601689.419811:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789601689.422879:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789601689.422891:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789601689.426032:0:18547:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601689.426304:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601689.426312:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789601689.427018:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601689.427030:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789601689.473462:0:18547:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601689.473755:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789601689.473762:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789601689.475103:0:18547:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789601689.475113:0:18547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789601689.476212:0:18547:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789601689.476253:0:18547:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789601689.476259:0:18547:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789601689.506511:0:18547:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789601689.506707:0:18547:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789601689.506714:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789601689.506717:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601689.506719:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601689.506720:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601689.506722:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601689.506724:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601689.506726:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601689.506729:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601689.506731:0:18547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601689.506747:0:18547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789601689.506751:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601689.506752:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601689.506761:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601689.506762:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601689.506763:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601689.506764:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601689.506765:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601689.506766:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601689.506767:0:18547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601689.506803:0:18547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789601689.506829:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415104:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789601689.507015:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601689.507141:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c2387f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.512015:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415104 00000100:00100000:0.0:1789601689.512038:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415104 00000100:00100000:0.0:1789601689.512187:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789601689.512201:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+18:18547:x1876532918415104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789601689.512262:0:17038:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789601689.512266:0:17038:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789601689.512271:0:17038:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789601689.513914:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+18:18547:x1876532918415104:12345-0@lo:253:mount.lustre.0 Request processed in 1706us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601689.513931:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789601689.514158:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789601689.514200:0:18547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789601689.514204:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789601689.514205:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601689.514207:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601689.514209:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601689.514210:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601689.514211:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601689.514225:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601689.514228:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601689.514230:0:18547:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789601689.514258:0:18547:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df4c363f000 from lustre-OST0000 10000000:01000000:3.0:1789601689.514325:0:18547:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789601689.514329:0:18547:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789601689.514340:0:18547:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f7638000 local copy 00010000:00010000:3.0:1789601689.514354:0:18547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601689.514520:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601689.514840:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.519300:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.519467:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415232 00000100:00100000:1.0:1789601689.519691:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415232 00000100:00100000:1.0:1789601689.519779:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601689.519792:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:18547:x1876532918415232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601689.519973:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:18547:x1876532918415232:12345-0@lo:501:mount.lustre.0 Request processed in 184us (5133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601689.519982:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601689.520862:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415232:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789601689.520960:0:18547:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789601689.521000:0:18547:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789601689.521011:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.521024:0:18547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601689.521063:0:18547:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4c363f000 10000000:01000000:3.0:1789601689.521087:0:18547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789601689.521094:0:18547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789601689.521097:0:18547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601689.521104:0:18547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789601689.521107:0:18547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789601689.521147:0:18547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.521156:0:18547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.521168:0:18547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601689.521191:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601689.521320:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.521414:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601689.522660:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415360 00000100:00100000:2.0:1789601689.522673:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415360 00000100:00100000:1.0:1789601689.524665:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789601689.524696:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+18:18547:x1876532918415360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601689.524722:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601689.524748:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f2888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2881 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601689.524790:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f2888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2881 expref: 19 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601689.524804:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f73ee200/0x74872e3eca9f2888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2881 expref: 19 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601689.524816:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f73ee200, rc 0) 00000100:00100000:1.0:1789601689.524963:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415360:12345-0@lo:101:mount.lustre.0 Request processed in 283us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.524972:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601689.525301:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601689.525325:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2888 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.525338:0:18547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2888 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601689.527863:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789601689.529153:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601689.533776:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789601689.533853:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789601689.533936:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789601689.533955:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789601689.533979:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789601689.533992:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789601689.534021:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789601689.534028:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789601689.534172:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601689.534342:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.543110:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.546369:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415488 00000100:00100000:0.0:1789601689.546392:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415488 00000100:00100000:2.0:1789601689.546650:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601689.546668:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601689.548437:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415488:12345-0@lo:501:mount.lustre.0 Request processed in 1765us (14085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.548455:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789601689.549057:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601689.549162:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601689.549392:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.549492:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.549700:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415616 00000100:00100000:0.0:1789601689.549709:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415616 00000100:00100000:0.0:1789601689.550111:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789601689.550122:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601689.551388:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415616:12345-0@lo:503:mount.lustre.0 Request processed in 1259us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601689.551403:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789601689.551533:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601689.552212:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601689.552324:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.552412:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.552479:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.552648:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415744 00000100:00100000:1.0:1789601689.552657:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415744 00000100:00100000:1.0:1789601689.553163:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601689.553257:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601689.555067:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415744:12345-0@lo:502:mount.lustre.0 Request processed in 1884us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.555084:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601689.555239:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601689.555850:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789601689.556150:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789601689.556167:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789601689.556182:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789601689.557010:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789601689.557043:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789601689.557058:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789601689.557071:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789601689.557086:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789601689.557098:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789601689.557126:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789601689.557139:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789601689.557197:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.558098:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.558193:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c62223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.558301:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918415872 00000100:00100000:1.0:1789601689.558312:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918415872 00000100:00100000:1.0:1789601689.558418:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601689.558430:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601689.558637:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918415872:12345-0@lo:502:mount.lustre.0 Request processed in 209us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.558645:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789601689.558769:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918415872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601689.558881:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789601689.558899:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789601689.560458:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789601689.560544:0:18564:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789601689.560703:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.560707:0:18564:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789601689.560828:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601689.560847:0:18564:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df4f3723380) 00000020:00000080:0.0:1789601689.560995:0:18564:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789601689.561004:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789601689.561105:0:18564:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4c363f000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789601689.561116:0:18564:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789601689.561135:0:18564:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x74872e3eca9f2896 00010000:00010000:1.0:1789601689.568951:0:18564:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789601689.569725:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789601689.572417:0:18564:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789601689.574396:0:18564:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789601689.574413:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601689.574421:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574423:0:18564:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789601689.574427:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789601689.574431:0:18564:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789601689.574433:0:18564:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601689.574434:0:18564:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789601689.574436:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789601689.574439:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574441:0:18564:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789601689.574443:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601689.574446:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574448:0:18564:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601689.574450:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601689.574453:0:18564:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789601689.574455:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601689.574458:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574459:0:18564:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789601689.574461:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601689.574464:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574475:0:18564:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789601689.574480:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789601689.574514:0:18564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601689.574517:0:18564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601689.574519:0:18564:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789601689.574522:0:18564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789601689.574877:0:18547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789601689.574917:0:18547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789601689.574941:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2888 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.574955:0:18547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678a00/0x74872e3eca9f2881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2888 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601689.574965:0:18547:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4c363f000 from 1 10000000:01000000:0.0:1789601689.574968:0:18547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601689.575016:0:18547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.575025:0:18547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.575038:0:18547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601689.575070:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601689.575156:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.575211:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66f4900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601689.575485:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416000 00000100:00100000:3.0:1789601689.575495:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416000 00000100:00100000:3.0:1789601689.575641:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789601689.575652:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+19:18547:x1876532918416000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601689.575668:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601689.575686:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f289d expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.575717:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f289d expref: 20 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.575730:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f289d expref: 20 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.575741:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c1678600, rc 0) 00000100:00100000:3.0:1789601689.575791:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416000:12345-0@lo:101:mount.lustre.0 Request processed in 141us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.575799:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789601689.576008:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601689.576028:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.576054:0:18547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601689.577686:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789601689.578022:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601689.578287:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789601689.578328:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789601689.578347:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789601689.578353:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789601689.578449:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601689.578761:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601689.586635:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416128 00000100:00100000:1.0:1789601689.586651:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416128 00000100:00100000:1.0:1789601689.586718:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601689.586729:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601689.586963:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416128:12345-0@lo:501:mount.lustre.0 Request processed in 235us (8202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.586972:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789601689.587318:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c55ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.587353:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601689.587429:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601689.587994:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.588067:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c55ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.588104:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416256 00000100:00100000:1.0:1789601689.588110:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416256 00000100:00100000:1.0:1789601689.588186:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789601689.588197:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601689.588326:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416256:12345-0@lo:503:mount.lustre.0 Request processed in 131us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.588334:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789601689.588416:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789601689.589201:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601689.589297:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601689.589353:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.590059:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d421e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601689.590181:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416384 00000100:00100000:3.0:1789601689.590190:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416384 00000100:00100000:3.0:1789601689.590233:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601689.590243:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.590395:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416384:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.590404:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789601689.590517:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601689.590789:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789601689.590823:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789601689.590840:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789601689.591085:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789601689.591115:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789601689.591130:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789601689.591143:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789601689.591156:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789601689.591170:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789601689.591184:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789601689.591198:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789601689.591239:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601689.591295:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.591336:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c66f4900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601689.591402:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416512 00000100:00100000:3.0:1789601689.591408:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416512 00000100:00100000:3.0:1789601689.591439:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789601689.591447:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.591668:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416512:12345-0@lo:502:mount.lustre.0 Request processed in 222us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.591684:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601689.591789:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601689.591840:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789601689.591850:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789601689.593141:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601689.593155:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.593158:0:18568:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789601689.593166:0:18568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4c363f000 00000020:00000080:0.0:1789601689.593169:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601689.593179:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601689.593182:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.593184:0:18568:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789601689.593186:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601689.593189:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.593191:0:18568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789601689.593194:0:18568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4c363f000 00000020:00000080:0.0:1789601689.593197:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601689.593309:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601689.593314:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.593315:0:18568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789601689.593319:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601689.593331:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.593332:0:18568:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601689.593338:0:18568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4c363f000 00000020:00000080:0.0:1789601689.593340:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601689.594806:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601689.594832:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.594834:0:18568:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601689.594838:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601689.594842:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.594844:0:18568:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789601689.594848:0:18568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4c363f000 00000020:00000080:0.0:1789601689.594850:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601689.594969:0:18568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601689.594973:0:18568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601689.594974:0:18568:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789601689.594978:0:18568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789601689.605679:0:18547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789601689.605746:0:18547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601689.605775:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.605791:0:18547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.606058:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601689.606765:0:18547:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789601689.606770:0:18547:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4c363f000 10000000:01000000:3.0:1789601689.606774:0:18547:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4c363f000 10000000:01000000:3.0:1789601689.606779:0:18547:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601689.606786:0:18547:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4c363f000 from 1 10000000:01000000:3.0:1789601689.606790:0:18547:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601689.606838:0:18547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.606849:0:18547:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.606862:0:18547:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601689.607308:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601689.607417:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.610011:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.613745:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416640 00000100:00100000:0.0:1789601689.613766:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416640 00000100:00100000:0.0:1789601689.614452:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789601689.614464:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:18547:x1876532918416640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601689.615159:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601689.615187:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f28b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f28ab expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.615335:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f28b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f28ab expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.615351:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467600/0x74872e3eca9f28b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f28ab expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.615374:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467600, rc 0) 00000100:00100000:0.0:1789601689.615628:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918416640:12345-0@lo:101:mount.lustre.0 Request processed in 1165us (8210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.615629:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601689.615637:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1789601689.615652:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28b2 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.615669:0:18547:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f28b2 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601689.617142:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789601689.618696:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601689.619304:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789601689.619337:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789601689.619370:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789601689.619385:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789601689.619396:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789601689.619409:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789601689.619423:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789601689.619435:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789601689.619445:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789601689.619458:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789601689.620016:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789601689.620054:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789601689.620071:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789601689.620086:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789601689.620099:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789601689.620112:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789601689.620125:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789601689.620138:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789601689.620152:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789601689.620167:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789601689.620180:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789601689.620192:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789601689.620205:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789601689.620217:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789601689.620231:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789601689.620244:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789601689.620270:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789601689.620298:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789601689.620312:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789601689.620324:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789601689.620335:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789601689.620347:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789601689.620370:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789601689.620385:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789601689.620397:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789601689.620409:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789601689.620420:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789601689.620442:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789601689.620448:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789601689.621774:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601689.621858:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.621923:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222540 going to sleep for 11 seconds 00000100:00100000:2.0:1789601689.622354:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416768 00000100:00100000:2.0:1789601689.622373:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416768 00000100:00100000:2.0:1789601689.622427:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601689.622438:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918416768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601689.622989:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918416768:12345-0@lo:501:mount.lustre.0 Request processed in 551us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.622999:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789601689.625640:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601689.625718:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601689.625796:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.625845:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.626095:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918416896 00000100:00100000:0.0:1789601689.626104:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918416896 00000100:00100000:0.0:1789601689.626197:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789601689.626208:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918416896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601689.626345:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918416896:12345-0@lo:503:mount.lustre.0 Request processed in 139us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601689.626353:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601689.626443:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918416896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601689.628788:0:18547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601689.628974:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.629067:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.629155:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.629209:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417024 00000100:00100000:0.0:1789601689.629219:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417024 00000100:00100000:0.0:1789601689.629307:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789601689.629318:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601689.629486:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417024:12345-0@lo:502:mount.lustre.0 Request processed in 169us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601689.629495:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789601689.629609:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601689.629837:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789601689.629887:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789601689.629904:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789601689.629934:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789601689.629950:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789601689.629963:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789601689.629974:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789601689.629984:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789601689.629994:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789601689.630006:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789601689.630019:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789601689.630031:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789601689.630041:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789601689.630053:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789601689.630065:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789601689.630079:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789601689.630092:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789601689.630103:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789601689.630114:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789601689.630142:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789601689.630158:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789601689.630170:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789601689.630183:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789601689.630196:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789601689.630209:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789601689.630223:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789601689.630236:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789601689.630248:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789601689.630260:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789601689.630272:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789601689.630285:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789601689.630298:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789601689.630310:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789601689.630323:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789601689.630346:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789601689.630388:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789601689.630406:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789601689.630421:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789601689.630435:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789601689.630447:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789601689.630459:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789601689.630473:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789601689.630485:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789601689.630499:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789601689.630513:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789601689.630527:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789601689.630541:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789601689.630583:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789601689.630636:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.630697:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.631139:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.631187:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417152 00000100:00100000:1.0:1789601689.631195:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417152 00000100:00100000:1.0:1789601689.631243:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789601689.631252:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601689.631446:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417152:12345-0@lo:502:mount.lustre.0 Request processed in 195us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.631455:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789601689.631749:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601689.632014:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789601689.632042:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789601689.632083:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601689.632125:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.632197:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601689.632233:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417280 00000100:00100000:1.0:1789601689.632238:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417280 00000100:00100000:1.0:1789601689.632304:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789601689.632313:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601689.632413:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918417280:12345-0@lo:502:mount.lustre.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.632420:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789601689.632487:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918417280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601689.632524:0:18547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789601689.632532:0:18547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789601689.634225:0:18573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789601689.634248:0:18573:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df4f3724d40) 00000020:00000080:0.0:1789601689.634279:0:18573:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789601689.634405:0:18573:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4c363f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789601689.634410:0:18573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4c363f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789601689.634413:0:18573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4c363f000 3 00010000:00080000:0.0:1789601689.634460:0:18573:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c1911000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789601689.637261:0:18573:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789601689.638657:0:18573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789601689.638720:0:18573:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789601689.638739:0:18573:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x74872e3eca9f28c0 00000100:00080000:0.0:1789601689.638764:0:18573:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601689.638782:0:18573:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df3c1911000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601689.638834:0:18573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c4065880 x1876532918417408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601689.638958:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918417408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601689.639044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789601689.639113:0:18573:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789601689.639167:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601689.639171:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601689.639174:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601689.639176:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601689.639201:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601689.639205:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601689.639207:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601689.639210:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789601689.639240:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918417664:0@lo:400:kworker.0 00000100:00100000:0.0:1789601689.639267:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.639288:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601689.639294:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918417536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601689.639317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.639344:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918417792:0@lo:400:kworker.0 00000100:00100000:0.0:1789601689.639381:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.639399:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601689.639414:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918417920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601689.639439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601689.640615:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417536 00000100:00100000:1.0:1789601689.640629:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417536 00000100:00100000:1.0:1789601689.640674:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417792 00000100:00100000:1.0:1789601689.640678:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417792 00000100:00100000:1.0:1789601689.640698:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601689.640708:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918417536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601689.640821:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918417536:12345-0@lo:400:kworker.0 Request processed in 114us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.640829:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601689.640848:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601689.640855:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918417792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601689.640900:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417408 00000100:00100000:2.0:1789601689.640905:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417408 00000100:00100000:2.0:1789601689.640985:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417664 00000100:00100000:2.0:1789601689.640990:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417664 00000100:00100000:2.0:1789601689.641011:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918417920 00000100:00100000:2.0:1789601689.641014:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918417920 00000100:00100000:1.0:1789601689.641022:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918417792:12345-0@lo:400:kworker.0 Request processed in 167us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.641029:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601689.641030:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601689.641036:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918417664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601689.641088:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918417664:12345-0@lo:400:kworker.0 Request processed in 53us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.641095:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601689.641112:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601689.641125:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601689.641158:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918417920:12345-0@lo:400:kworker.0 Request processed in 33us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.641164:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601689.641178:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601689.641182:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918417408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789601689.641208:0:17045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1789601689.641412:0:17045:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x74872e3eca9f28c7 00000004:00100000:2.0:1789601689.641431:0:17045:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789601689.641473:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8df4eabd8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601689.641664:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876532918417408:12345-0@lo:38:llog_process_th.0 Request processed in 479us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.641671:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601689.641829:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c4065880 x1876532918417408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601689.641842:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601689.641853:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789601689.641861:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789601689.641867:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789601689.641881:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c1911000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789601689.641889:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876532918417408:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789601689.642870:0:18573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789601689.642889:0:18573:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8df4f8d93380) 00000020:00000080:2.0:1789601689.642916:0:18573:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789601689.643157:0:18573:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4c363f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789601689.643162:0:18573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4c363f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789601689.643165:0:18573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4c363f000 3 00010000:00080000:2.0:1789601689.643199:0:18573:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4eabde800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.148@tcp at head 00000100:00100000:0.0:1789601689.644738:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918417536:0@lo:400:kworker.0 00010000:00080000:0.0:1789601689.644761:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c4067100 x1876532918417664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601689.644774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918417664:0@lo:400:kworker.0 00010000:00080000:0.0:1789601689.644828:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73ced80 x1876532918417920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601689.644838:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918417920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601689.644851:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918417792:0@lo:400:kworker.0 00010000:00010000:2.0:1789601689.645808:0:18573:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789601689.646048:0:18573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789601689.646100:0:18573:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601689.646112:0:18573:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x74872e3eca9f28d5 00000100:00080000:2.0:1789601689.646123:0:18573:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601689.646135:0:18573:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8df4eabde800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601689.646180:0:18573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4cd0bad80 x1876532918418048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601689.646231:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918418048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789601689.646315:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601689.646866:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418048 00000100:00100000:2.0:1789601689.646876:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418048 00000100:00100000:2.0:1789601689.646975:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601689.646986:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876532918418048:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789601689.647017:0:17045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1789601689.647134:0:17045:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x74872e3eca9f28dc 00000004:00100000:2.0:1789601689.647153:0:17045:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789601689.647194:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601689.647933:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876532918418048:12345-0@lo:38:llog_process_th.0 Request processed in 933us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601689.647943:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789601689.648008:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bad80 x1876532918418048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601689.648021:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601689.648031:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789601689.648040:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789601689.648045:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789601689.648048:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4eabde800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789601689.648056:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876532918418048:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789601689.648093:0:18573:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789601689.648243:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601689.648250:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601689.648260:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601689.648263:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601689.648267:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601689.648270:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601689.648273:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601689.648276:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789601689.652800:0:18573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789601689.653135:0:18547:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789601689.653181:0:18547:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601689.653211:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28b2 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.653226:0:18547:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c1678400/0x74872e3eca9f28ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28b2 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601689.653300:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601689.653303:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601689.653305:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601689.653306:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601689.653307:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601689.653309:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601689.653310:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601689.653313:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601689.653314:0:18547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601689.653319:0:18547:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789601689.653330:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601689.653331:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601689.653332:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601689.653333:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601689.653334:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601689.653335:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601689.653335:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601689.653337:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601689.653337:0:18547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601689.653383:0:18547:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789601689.653409:0:18547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918418176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601689.653515:0:18547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601689.653592:0:18547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d99f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601689.653618:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418176 00000100:00100000:0.0:1789601689.653629:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418176 00000100:00100000:0.0:1789601689.653697:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789601689.653708:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918418176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789601689.653744:0:17038:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789601689.653761:0:17038:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789601689.668459:0:17038:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789601689.668482:0:17038:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789601689.668607:0:17061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789601689.668614:0:17061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789601689.668641:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.668666:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.668675:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.668683:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.668802:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.668927:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601689.668946:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918418304:0@lo:104: 00000100:00100000:3.0:1789601689.669091:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601689.669167:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.669176:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 21 pid: 17038 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601689.669186:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918418432:0@lo:104: 00000100:00100000:3.0:1789601689.669213:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601689.669231:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c6222b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601689.669266:0:17029:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789601689.669289:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418304 00000100:00100000:3.0:1789601689.669297:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418304 00000100:00100000:3.0:1789601689.669342:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418432 00000100:00100000:3.0:1789601689.669345:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418432 00000100:00100000:3.0:1789601689.669379:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601689.669389:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918418304:12345-0@lo:104: 00010000:00010000:3.0:1789601689.669406:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.669464:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601689.669471:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918418304:12345-0@lo:104: Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.669479:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601689.669499:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601689.669505:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c6c4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918418432:12345-0@lo:104: 00010000:00010000:3.0:1789601689.669514:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.669552:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789601689.669588:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c6c4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918418432:12345-0@lo:104: Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.669594:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601689.669663:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918418304:0@lo:104: 00000100:00100000:3.0:1789601689.669673:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918418432:0@lo:104: 00010000:00010000:3.0:1789601689.669697:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.669718:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601689.669725:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601689.670346:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:18547:x1876532918418176:12345-0@lo:253:mount.lustre.0 Request processed in 16638us (16829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601689.670368:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1789601689.672461:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1679e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601689.672468:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672480:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601689.672487:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601689.672492:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601689.672578:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672584:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601689.672619:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672646:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1679e00/0x74872e3eca9f2834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f283b expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672669:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601689.672674:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672680:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c1678e00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601689.672683:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672690:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601689.672695:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601689.672700:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601689.672714:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.672719:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789601689.672846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918418688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601689.673023:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601689.673161:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.673169:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4c1678e00/0x74872e3eca9f2826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f282d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.673186:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601689.673194:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601689.673197:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601689.673206:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601689.673238:0:18547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:18547:1876532918418176:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601689.673255:0:18547:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789601689.673259:0:18547:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601689.673261:0:18547:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601689.673263:0:18547:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601689.673265:0:18547:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601689.673266:0:18547:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601689.673268:0:18547:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601689.673270:0:18547:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601689.673272:0:18547:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601689.673274:0:18547:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601689.673292:0:18547:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789601689.674893:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918418560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601689.674978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601689.675059:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418688 00000100:00100000:2.0:1789601689.675068:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418688 00000100:00100000:0.0:1789601689.675107:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418560 00010000:00010000:2.0:1789601689.675110:0:17030:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 21 pid: 17038 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601689.675114:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418560 00010000:00010000:0.0:1789601689.675140:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 22 pid: 17037 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601689.675160:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601689.675170:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+22:3648:x1876532918418688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601689.675185:0:17030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601689.675192:0:17030:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 22 pid: 17038 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601689.675204:0:17030:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 22 pid: 17038 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601689.675236:0:17030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f282d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f2826 expref: 22 pid: 17038 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601689.675252:0:17030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601689.678112:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+21:3648:x1876532918418688:12345-0@lo:103:ldlm_bl.0 Request processed in 2932us (5088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601689.680286:0:17032:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789601689.680309:0:17032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789601689.680920:0:17031:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789601689.680947:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601689.680962:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2242450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+21:3647:x1876532918418560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601689.680985:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601689.681004:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681035:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681059:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679600/0x74872e3eca9f283b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f2834 expref: 21 pid: 17037 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681077:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681087:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601689.681106:0:17031:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018102256s 00010000:00010000:3.0:1789601689.681111:0:17031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601689.681113:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918418688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601689.681123:0:17031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681130:0:17031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681150:0:17031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681157:0:17031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601689.681162:0:17031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681170:0:17031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681195:0:17031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601689.681208:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601689.681300:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2242450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0068b5de-bd03-471c-817a-758c66ef4c46+20:3647:x1876532918418560:12345-0@lo:103:ldlm_bl.0 Request processed in 342us (6321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601689.681310:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601689.681318:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601689.681468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918418560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601689.682183:0:17061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.682196:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601689.682204:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f7382a00/0x74872e3eca9f28e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789601689.684231:0:18547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789601689.688327:0:18547:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789601689.688340:0:18547:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789601689.688407:0:18547:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789601689.688502:0:18547:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789601689.688527:0:18547:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789601689.688584:0:18547:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789601689.689727:0:18547:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601689.689984:0:18547:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789601690.440867:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918418816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601690.440961:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601690.441361:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418816 00000100:00100000:2.0:1789601690.441372:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418816 00000100:00100000:2.0:1789601690.441449:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789601690.441461:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918418816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601690.441503:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789601690.441583:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918418816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601690.441591:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601690.443324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918418944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789601690.443416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601690.443510:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918418944 00000100:00100000:2.0:1789601690.443520:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918418944 00000100:00100000:2.0:1789601690.443614:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601690.443619:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918418816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601690.443627:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918418944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601690.443664:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789601690.443725:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918418944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601690.443732:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601690.443928:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918418944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601690.636714:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789601690.871058:0:18627:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789601690.872264:0:18627:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789601691.141995:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601691.142005:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4e01b3800 from 9 10000000:01000000:2.0:1789601691.142011:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601691.142069:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.142083:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.142097:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601691.142131:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601691.147101:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601691.147172:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601691.147218:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419072 00000100:00100000:2.0:1789601691.147230:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419072 00000100:00100000:2.0:1789601691.147293:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601691.147304:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+19:17042:x1876532918419072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601691.147326:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601691.147365:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f28ea expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.147402:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 20 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.147415:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 20 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.147426:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d800, rc 0) 00000100:00100000:2.0:1789601691.147476:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+20:17042:x1876532918419072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601691.147484:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601691.147547:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601691.147589:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.147600:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601691.147677:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601691.147717:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601691.147739:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601691.147752:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419200 00000100:00100000:2.0:1789601691.147756:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419200 00000100:00100000:2.0:1789601691.147779:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789601691.147786:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:17042:x1876532918419200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789601691.147799:0:17038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601691.147817:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601691.147820:0:17038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789601691.147907:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:17042:x1876532918419200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601691.147915:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789601691.147945:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789601691.148007:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601691.148015:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148023:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601691.148034:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601691.148037:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df3c41ab800 from 9 10000000:01000000:2.0:1789601691.148040:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601691.148061:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148070:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148089:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601691.148102:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601691.148127:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601691.148139:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601691.148151:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419328 00000100:00100000:2.0:1789601691.148155:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419328 00000100:00100000:2.0:1789601691.148175:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789601691.148180:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+20:17042:x1876532918419328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601691.148188:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601691.148199:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f28f8 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148216:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148225:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148232:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d200, rc 0) 00000100:00100000:2.0:1789601691.148258:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918419328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601691.148264:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789601691.148293:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601691.148302:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.148316:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601691.153038:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601691.153129:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601691.153192:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c506b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601691.153226:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419456 00000100:00100000:2.0:1789601691.153331:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419456 00000100:00100000:2.0:1789601691.153401:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789601691.153411:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918419456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789601691.153436:0:17037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601691.153459:0:17037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601691.153462:0:17037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789601691.153587:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918419456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601691.153595:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789601691.153650:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918419456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789601691.153712:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601691.153722:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601691.153735:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601691.661643:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789601692.295490:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601692.680061:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601693.702729:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601694.727105:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789601695.050958:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601695.050965:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601695.050969:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601695.050972:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601695.050998:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601695.051002:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601695.051006:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601695.051009:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789601695.051091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918419584:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051180:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918420096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051294:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789601695.051300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918419712:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051357:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918420224:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051426:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918419840:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051452:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918420352:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051503:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051515:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601695.051520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918419968:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.051539:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601695.051590:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419584 00000100:00100000:1.0:1789601695.051599:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419584 00000100:00100000:1.0:1789601695.051650:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601695.051659:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:3647:x1876532918419584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.052647:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420096 00000100:00100000:0.0:1789601695.052656:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420096 00000100:00100000:0.0:1789601695.052766:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420224 00000100:00100000:0.0:1789601695.052770:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420224 00000100:00100000:0.0:1789601695.052867:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419840 00000100:00100000:0.0:1789601695.052871:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419840 00000100:00100000:0.0:1789601695.052884:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420352 00000100:00100000:0.0:1789601695.052886:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420352 00000100:00100000:0.0:1789601695.052902:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601695.052910:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918420096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053009:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918420096:12345-0@lo:400:kworker.0 Request processed in 99us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053017:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601695.053037:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601695.053045:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918420224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053073:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918420224:12345-0@lo:400:kworker.0 Request processed in 30us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053079:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601695.053090:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601695.053097:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053126:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918419840:12345-0@lo:400:kworker.0 Request processed in 31us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053132:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601695.053143:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601695.053150:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918420352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053177:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918420352:12345-0@lo:400:kworker.0 Request processed in 29us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053182:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601695.053204:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419712 00000100:00100000:0.0:1789601695.053208:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419712 00000100:00100000:0.0:1789601695.053227:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918419968 00000100:00100000:0.0:1789601695.053231:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918419968 00000100:00100000:0.0:1789601695.053242:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601695.053248:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918419712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053281:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918419712:12345-0@lo:400:kworker.0 Request processed in 33us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053296:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601695.053308:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601695.053314:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918419968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.053354:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918419968:12345-0@lo:400:kworker.0 Request processed in 41us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.053360:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789601695.053503:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601695.053514:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601695.053904:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:3647:x1876532918419584:12345-0@lo:400:kworker.0 Request processed in 2243us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601695.053914:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601695.053994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918419712:0@lo:400:kworker.0 00010000:00080000:1.0:1789601695.054011:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359d180 x1876532918420224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601695.054023:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918420224:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.054036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918419584:0@lo:400:kworker.0 00010000:00080000:1.0:1789601695.054048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359d880 x1876532918420096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601695.054057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918420096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601695.054095:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918419968:0@lo:400:kworker.0 00010000:00080000:1.0:1789601695.054108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359ca80 x1876532918419840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601695.054117:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918419840:0@lo:400:kworker.0 00010000:00080000:1.0:1789601695.054139:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359e300 x1876532918420352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601695.054148:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918420352:0@lo:400:kworker.0 00000100:00100000:0.0:1789601695.557856:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918420480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601695.557954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601695.558030:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420480 00000100:00100000:0.0:1789601695.558042:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420480 00000100:00100000:0.0:1789601695.558112:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601695.558123:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918420480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601695.558165:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789601695.558237:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918420480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601695.558245:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601695.558302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918420480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601695.558512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601695.558525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918420608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601695.558591:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601695.558620:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420608 00000100:00100000:2.0:1789601695.558624:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420608 00000100:00100000:2.0:1789601695.558649:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601695.558656:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918420608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601695.558677:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789601695.558711:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918420608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601695.558717:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601695.558752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918420608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789601695.755943:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601696.454967:0:18917:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789601696.773753:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601697.670868:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789601697.673869:0:18969:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601697.674377:0:18969:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789601697.802223:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789601698.753841:0:19019:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789601698.754029:0:19019:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601698.826723:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601699.845936:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601700.166716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601700.166723:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601700.166725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601700.166728:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601700.166743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601700.166761:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601700.166763:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601700.166766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789601700.166853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918420736:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.166931:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.166975:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918421248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167031:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601700.167037:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918421120:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167059:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167089:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420736 00000100:00100000:2.0:1789601700.167097:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420736 00000100:00100000:2.0:1789601700.167149:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789601700.167156:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:3648:x1876532918420736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167202:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:3648:x1876532918420736:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167209:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789601700.167248:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421248 00000100:00100000:2.0:1789601700.167252:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421248 00000100:00100000:2.0:1789601700.167277:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601700.167296:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918421248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167326:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918421248:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167332:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601700.167349:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421120 00000100:00100000:2.0:1789601700.167353:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421120 00000100:00100000:2.0:1789601700.167374:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601700.167379:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918421120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167407:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918421120:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167413:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601700.167450:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918421120:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918420736:0@lo:400:kworker.0 00010000:00080000:2.0:1789601700.167469:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cf480 x1876532918421248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601700.167478:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918421248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918420864:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167587:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918421376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167610:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167627:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789601700.167633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918420992:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167651:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167664:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918421504:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167681:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.167705:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421376 00000100:00100000:2.0:1789601700.167709:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421376 00000100:00100000:2.0:1789601700.167738:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420992 00000100:00100000:2.0:1789601700.167740:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420992 00000100:00100000:2.0:1789601700.167752:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421504 00000100:00100000:2.0:1789601700.167754:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421504 00000100:00100000:2.0:1789601700.167769:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601700.167774:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918421376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167805:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876532918421376:12345-0@lo:400:kworker.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167812:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601700.167824:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601700.167829:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918420992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167854:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876532918420992:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167860:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601700.167871:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601700.167876:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918421504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167913:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918421504:12345-0@lo:400:kworker.0 Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.167919:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789601700.167935:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601700.167939:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601700.167945:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918420864 00000100:00100000:2.0:1789601700.167948:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918420864 00000100:00100000:2.0:1789601700.167966:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601700.167971:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918420864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.167996:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918420864:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.168002:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789601700.168028:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cdf80 x1876532918420992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601700.168038:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876532918420992:0@lo:400:kworker.0 00010000:00080000:2.0:1789601700.168047:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cc000 x1876532918421504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601700.168055:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918421504:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.168063:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918420864:0@lo:400:kworker.0 00010000:00080000:2.0:1789601700.168072:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cce00 x1876532918421376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601700.168080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876532918421376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601700.680350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918421632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601700.680423:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.680496:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421632 00000100:00100000:2.0:1789601700.680503:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421632 00000100:00100000:2.0:1789601700.680549:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601700.680575:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918421632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601700.680608:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789601700.680654:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918421632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601700.680661:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601700.680680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918421632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601700.684122:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918421760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601700.684194:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601700.684404:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421760 00000100:00100000:0.0:1789601700.684413:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421760 00000100:00100000:0.0:1789601700.684511:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789601700.684523:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918421760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789601700.684589:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789601700.684642:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918421760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601700.684649:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789601700.685026:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918421760:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601700.869968:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601700.933660:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601685/real 1789601685] req@ffff8df3c36af800 x1876532918414592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601700.933762:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c36af800 x1876532918414592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601700.933772:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601685/real 1789601685] req@ffff8df3c36ad500 x1876532918414720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601700.933783:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c36ad500 x1876532918414720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601700.933805:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2390800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601700.933827:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601700.933831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918414592:0@lo:8:kworker.0 00000100:00080000:0.0:1789601700.933836:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601700.933850:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601700.933854:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918414720:0@lo:8:kworker.0 00000100:00080000:1.0:1789601700.933981:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601700.933986:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601700.933989:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601700.933992:0:13926:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601700.934016:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601700.934019:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789601700.934022:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df3c2390800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601700.934027:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789601700.934042:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789601700.934053:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df3c2390800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601700.934071:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359d180 x1876532918422400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601700.934085:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601700.934088:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789601700.934090:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601700.934093:0:13926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789601700.934096:0:13926:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789601700.934100:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789601700.934116:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c359fb80 x1876532918422528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601700.934170:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934227:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934262:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918422784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934297:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934318:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601700.934324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934349:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934375:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918422656:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918422144:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934457:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918422912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934495:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934506:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601700.934512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918422272:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.934529:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.934581:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422016 00000100:00100000:1.0:1789601700.934588:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422016 00000100:00100000:1.0:1789601700.934622:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422272 00000100:00100000:1.0:1789601700.934625:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422272 00000100:00100000:1.0:1789601700.934640:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601700.934648:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935199:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918422016:12345-0@lo:400:kworker.0 Request processed in 549us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935215:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601700.935234:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601700.935241:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918422272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935289:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918422272:12345-0@lo:400:kworker.0 Request processed in 49us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935295:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601700.935317:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422784 00000100:00100000:1.0:1789601700.935321:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422784 00000100:00100000:1.0:1789601700.935341:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422656 00000100:00100000:1.0:1789601700.935344:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422656 00000100:00100000:1.0:1789601700.935355:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422144 00000100:00100000:1.0:1789601700.935357:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422144 00000100:00100000:1.0:1789601700.935365:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422912 00000100:00100000:1.0:1789601700.935367:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422912 00000100:00100000:1.0:1789601700.935378:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601700.935590:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918422784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935626:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918422784:12345-0@lo:400:kworker.0 Request processed in 39us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935632:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601700.935644:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601700.935650:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918422656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935824:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918422656:12345-0@lo:400:kworker.0 Request processed in 173us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935831:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601700.935844:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601700.935850:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935891:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918422144:12345-0@lo:400:kworker.0 Request processed in 41us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935898:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601700.935911:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601700.935917:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918422912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.935942:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918422912:12345-0@lo:400:kworker.0 Request processed in 26us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.935948:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601700.935979:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918421888 00000100:00100000:1.0:1789601700.935983:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918421888 00000100:00100000:1.0:1789601700.936017:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601700.936024:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:3646:x1876532918421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.936054:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:3646:x1876532918421888:12345-0@lo:400:kworker.0 Request processed in 31us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.936060:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601700.936116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918422272:0@lo:400:kworker.0 00010000:00080000:1.0:1789601700.936131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359d880 x1876532918422144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.936149:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918422144:0@lo:400:kworker.0 00010000:00080000:1.0:1789601700.936160:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c4066d80 x1876532918422912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.936166:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918422912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.936197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918422400:0@lo:8:kworker.0 00000100:00100000:1.0:1789601700.936239:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.936269:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918422528:0@lo:8:kworker.0 00000100:00100000:1.0:1789601700.936305:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.936344:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918421888:0@lo:400:kworker.0 00010000:00080000:1.0:1789601700.936355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359c700 x1876532918422656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.936363:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918422656:0@lo:400:kworker.0 00000100:00100000:1.0:1789601700.936374:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918422016:0@lo:400:kworker.0 00010000:00080000:1.0:1789601700.936396:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359e300 x1876532918422784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.936405:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918422784:0@lo:400:kworker.0 00000100:00100000:3.0:1789601700.936603:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422400 00000100:00100000:3.0:1789601700.936608:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422400 00000100:00100000:3.0:1789601700.936637:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918422528 00000100:00100000:3.0:1789601700.936640:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918422528 00000100:00100000:3.0:1789601700.936650:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601700.936656:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918422400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789601700.936692:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:3.0:1789601700.936719:0:18552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f2906 00002000:00100000:3.0:1789601700.936732:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8df4eaba7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789601700.936737:0:18552:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789601700.936739:0:18552:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789601700.936900:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789601700.936923:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df4eaba4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601700.936964:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918422400:12345-0@lo:8:kworker.0 Request processed in 307us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601700.936970:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601700.936984:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601700.936989:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918422528:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789601700.937000:0:18552:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789601700.939114:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c359d180 x1876532918422400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.939127:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601700.939145:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789601700.939155:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789601700.939160:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789601700.939163:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2390800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789601700.939193:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789601700.939200:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918422400:0@lo:8:kworker.0 00000004:00080000:2.0:1789601700.939349:0:17787:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789601700.939371:0:17787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423168:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789601700.939433:0:17787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.939456:0:17787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601700.939474:0:18554:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601700.939481:0:18554:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789601700.939579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601700.939591:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918423040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601700.939615:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601700.939654:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423168 00000100:00100000:2.0:1789601700.939660:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423168 00000100:00080000:2.0:1789601700.939709:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601700.939779:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601700.939787:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17787:x1876532918423168:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789601700.944884:0:17786:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789601700.945922:0:17786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 569067363547ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789601700.945931:0:17786:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789601700.946041:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423040 00000100:00100000:0.0:1789601700.946050:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423040 00000100:00100000:0.0:1789601700.946105:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601700.946116:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876532918423040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601700.946146:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789601700.946228:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876532918423040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (6611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601700.946235:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789601700.946290:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bb480 x1876532918423040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601700.946309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918423040:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789601700.947908:0:17778:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789601700.961902:0:19127:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789601700.961914:0:19127:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789601700.962055:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17787:x1876532918423168:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22263us (22617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601700.962069:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789601700.968112:0:17787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b8e00 x1876532918423168/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601716 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.968146:0:17787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423168:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789601700.968162:0:17787:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789601700.968211:0:17787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423296:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789601700.968264:0:17787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.968311:0:17787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601700.968349:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423296 00000100:00100000:1.0:1789601700.968356:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423296 00000100:00100000:1.0:1789601700.968400:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601700.968410:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17787:x1876532918423296:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789601700.968436:0:18554:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789601700.968474:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17787:x1876532918423296:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601700.968480:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601700.968513:0:17787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c3424000 x1876532918423296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601716 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601700.968521:0:17787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423296:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789601700.968532:0:17787:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789601700.968571:0:17787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423424:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789601700.968593:0:17787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601700.968610:0:17787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601700.969071:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423424 00000100:00100000:0.0:1789601700.969076:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423424 00000100:00100000:0.0:1789601700.969117:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601700.969125:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17787:x1876532918423424:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789601700.969151:0:19127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789601700.970484:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918422528:12345-0@lo:8:kworker.0 Request processed in 33489us (34173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789601700.970494:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789601700.971108:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601700.971114:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601700.971118:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918422528:0@lo:8:kworker.0 00000001:00080000:1.0:1789601701.020295:0:18548:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789601701.020310:0:18548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789601701.020459:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17787:x1876532918423424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 51331us (51860us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789601701.020469:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789601701.020517:0:17787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c3424000 x1876532918423424/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601716 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601701.020527:0:17787:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789601701.020533:0:17787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17787:1876532918423424:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789601701.020550:0:17787:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789601701.020619:0:17787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17787:1876532918423552:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789601701.020652:0:17787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601701.021427:0:17787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601701.025883:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423552 00000100:00100000:0.0:1789601701.025904:0:17057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423552 00000100:00100000:0.0:1789601701.025966:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601701.025977:0:17057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17787:x1876532918423552:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789601701.026080:0:17057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17787:x1876532918423552:12345-0@lo:900:osp-pre-0-1.0 Request processed in 106us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601701.026087:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601701.026223:0:17787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c3424000 x1876532918423552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601701.026238:0:17787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17787:1876532918423552:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789601701.894180:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601702.534260:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601702.917853:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601703.941758:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601704.967524:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601705.032620:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601685/real 1789601685] req@ffff8df3c36aed80 x1876532918414208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601705.032648:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c36aed80 x1876532918414208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601705.032658:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601685/real 1789601685] req@ffff8df3c36adc00 x1876532918414336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601705.032668:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df3c36adc00 x1876532918414336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601705.032686:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601705.032699:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601705.032703:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918414208:0@lo:8:kworker.0 00000100:00080000:0.0:1789601705.032709:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601705.032714:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601705.032725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918414336:0@lo:8:kworker.0 00000100:00080000:0.0:1789601705.032807:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601705.032811:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789601705.032814:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601705.032818:0:1385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1789601705.032822:0:1385:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789601705.032833:0:1385:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df4f70a0800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601705.032850:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4f73cdc00 x1876532918423936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601705.032862:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601705.032864:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789601705.032866:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601705.032869:0:1385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1789601705.032871:0:1385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789601705.032874:0:1385:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601705.032883:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4f73cea00 x1876532918424064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601705.032929:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601705.032932:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789601705.032934:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601705.032937:0:1385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1789601705.032940:0:1385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789601705.032943:0:1385:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601705.032953:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4f73cdf80 x1876532918424576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601705.032998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918423680:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.033077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.033726:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918423808:0@lo:400:kworker.0 00000100:00100000:1.0:1789601705.033863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.033962:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918424448:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034001:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.034034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918424192:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.034078:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918424832:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.034115:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789601705.034121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.034154:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918424960:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.034217:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423680 00000100:00100000:0.0:1789601705.034224:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423680 00000100:00100000:0.0:1789601705.034280:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789601705.034289:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:3645:x1876532918423680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.034339:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:3645:x1876532918423680:12345-0@lo:400:kworker.0 Request processed in 51us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.034345:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789601705.035149:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424192 00000100:00100000:0.0:1789601705.035155:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424192 00000100:00100000:0.0:1789601705.035444:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424832 00000100:00100000:0.0:1789601705.035448:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424832 00000100:00100000:0.0:1789601705.035475:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424960 00000100:00100000:0.0:1789601705.035483:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424960 00000100:00100000:0.0:1789601705.035502:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601705.035510:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035575:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918424192:12345-0@lo:400:kworker.0 Request processed in 66us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.035582:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601705.035596:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601705.035603:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035630:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918424832:12345-0@lo:400:kworker.0 Request processed in 29us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.035636:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601705.035646:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601705.035652:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918424960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035675:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918424960:12345-0@lo:400:kworker.0 Request processed in 25us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.035681:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601705.035697:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423808 00000100:00100000:0.0:1789601705.035700:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423808 00000100:00100000:0.0:1789601705.035716:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424320 00000100:00100000:0.0:1789601705.035718:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424320 00000100:00100000:0.0:1789601705.035729:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789601705.035734:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035764:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918423808:12345-0@lo:400:kworker.0 Request processed in 30us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.035770:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789601705.035782:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789601705.035789:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035825:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918424320:12345-0@lo:400:kworker.0 Request processed in 37us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.035831:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789601705.035851:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601705.035855:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601705.035865:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918423936:0@lo:8:kworker.0 00000100:00100000:1.0:1789601705.035877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918423808:0@lo:400:kworker.0 00000100:00100000:1.0:1789601705.035886:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918424704:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.035892:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.035907:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.037508:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918424064:0@lo:8:kworker.0 00000100:00100000:0.0:1789601705.037578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.037603:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918424576:0@lo:8:kworker.0 00000100:00100000:0.0:1789601705.037625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.037669:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424448 00000100:00100000:0.0:1789601705.037677:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424448 00000100:00100000:0.0:1789601705.037717:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918423936 00000100:00100000:0.0:1789601705.037721:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918423936 00000100:00100000:0.0:1789601705.037730:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424064 00000100:00100000:0.0:1789601705.037732:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424064 00000100:00100000:0.0:1789601705.037738:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424576 00000100:00100000:0.0:1789601705.037739:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424576 00000100:00100000:0.0:1789601705.037751:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601705.037764:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.037810:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918424448:12345-0@lo:400:kworker.0 Request processed in 51us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.037816:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601705.037831:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601705.037835:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918423936:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789601705.037860:0:18554:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1789601705.037899:0:18554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f290d 00002000:00100000:0.0:1789601705.037913:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df4efcc9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789601705.037917:0:18554:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789601705.037920:0:18554:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789601705.037996:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789601705.038020:0:18554:0:(import.c:65:import_set_state_nolock()) ffff8df4efcca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601705.038060:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918423936:12345-0@lo:8:kworker.0 Request processed in 222us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.038066:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601705.038077:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601705.038081:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918424064:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789601705.038094:0:18554:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789601705.039710:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601705.039720:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876532918424576:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789601705.039740:0:18553:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789601705.039799:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876532918424576:12345-0@lo:8:kworker.0 Request processed in 79us (2172us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601705.039814:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601705.039839:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918424704 00000100:00100000:1.0:1789601705.039846:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918424704 00000100:00100000:1.0:1789601705.040033:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601705.040041:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918424704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601705.040546:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918424704:12345-0@lo:400:kworker.0 Request processed in 505us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.040567:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789601705.044994:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cf480 x1876532918424704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.045013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918424704:0@lo:400:kworker.0 00000100:00080000:1.0:1789601705.046633:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601705.046679:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918424320:0@lo:400:kworker.0 00010000:00080000:1.0:1789601705.046696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73ce300 x1876532918424960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.046705:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918424960:0@lo:400:kworker.0 00010000:00080000:1.0:1789601705.046716:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cce00 x1876532918424192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.046725:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918424192:0@lo:400:kworker.0 00010000:00080000:1.0:1789601705.046736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cd180 x1876532918424832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.046743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918424832:0@lo:400:kworker.0 00000100:00100000:1.0:1789601705.048615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918423680:0@lo:400:kworker.0 00010000:00080000:1.0:1789601705.048649:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cc000 x1876532918424448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.048660:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918424448:0@lo:400:kworker.0 00010000:00080000:1.0:1789601705.051548:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4f73cdc00 x1876532918423936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.051578:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601705.051588:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789601705.051598:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789601705.051603:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789601705.051607:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4f70a0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789601705.051636:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789601705.051643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918423936:0@lo:8:kworker.0 00000100:00080000:1.0:1789601705.051659:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601705.051664:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789601705.051668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918424576:0@lo:8:kworker.0 00000004:00080000:2.0:1789601705.051795:0:17070:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789601705.051818:0:17070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17070:1876532918425216:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789601705.051888:0:17070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.051915:0:17070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8245240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601705.051932:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425216 00000100:00100000:2.0:1789601705.051938:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425216 00000100:00100000:2.0:1789601705.051995:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601705.052004:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17070:x1876532918425216:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789601705.054322:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918425088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601705.054420:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789601705.056264:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601705.058161:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425088 00000100:00100000:2.0:1789601705.058175:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425088 00000100:00100000:2.0:1789601705.058229:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601705.058238:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918425088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601705.058281:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601705.058434:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876532918425088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (4013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.058442:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601705.059202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0b8e00 x1876532918425088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601705.059223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918425088:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789601705.059897:0:18553:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789601705.059905:0:18553:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789601705.059910:0:18553:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:0.0:1789601705.061340:0:17069:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789601705.062712:0:17069:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 573184153428ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789601705.062724:0:17069:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789601705.072628:0:17025:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789601705.073744:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918424064:12345-0@lo:8:kworker.0 Request processed in 35655us (36161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789601705.073757:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00010000:2.0:1789601705.074202:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.074211:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074227:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.074231:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.074237:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074269:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074289:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074297:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074318:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601705.074329:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601705.074335:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074342:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.074346:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789601705.074481:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601705.074486:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789601705.074490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918424064:0@lo:8:kworker.0 00010000:00010000:2.0:1789601705.074549:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074630:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074637:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f2914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.074653:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.074660:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.074661:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.075537:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.075546:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.075575:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.075579:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.075585:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.075596:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.075605:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.075613:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.075629:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.076011:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.076017:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.076037:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737ca00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.076041:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.076049:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.076064:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.076072:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f291b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.076087:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.076089:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.076090:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.076160:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.076165:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.076173:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.076176:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.076179:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.076195:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.076203:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.076210:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.076270:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.078877:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.078890:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.078903:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.078908:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.078919:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.078946:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.078955:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.078974:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.078977:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.078978:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.080105:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.080115:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080129:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.080133:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.080139:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080152:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080162:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080183:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080199:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601705.080210:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601705.080214:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080221:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.080225:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080234:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080260:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080268:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc3de7e9/0x74872e3eca9f2929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.080282:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.080284:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.080285:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601705.083170:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.083183:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083199:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.083204:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.083211:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083224:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083234:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083252:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083290:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.083303:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.083309:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083317:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.083321:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083331:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.083347:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.084600:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc11d55/0x74872e3eca9f2930 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.084629:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.084631:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.084633:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601705.088102:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.088115:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.088132:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.088148:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.088154:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.088181:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.088193:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.088200:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.088222:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601705.089705:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.089717:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.089730:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.089734:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.089739:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.089751:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.089761:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.089778:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.089803:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789601705.090291:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.090298:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090307:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.090311:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.090314:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090324:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090331:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090338:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090363:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789601705.090374:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789601705.090380:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090394:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466e00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.090398:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090409:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090425:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090433:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cc51ae/0x74872e3eca9f2937 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090450:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601705.090453:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090459:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.090462:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090470:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090478:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090492:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df046921/0x74872e3eca9f293e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090506:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.090509:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090516:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.090519:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090528:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090539:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090546:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996cde05/0x74872e3eca9f2945 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090576:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.090578:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.090580:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601705.090929:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.090935:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.090950:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.090953:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.091076:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091087:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091096:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091102:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091117:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.091126:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.091129:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091136:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.091140:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091147:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091270:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091277:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095e0e9d2/0x74872e3eca9f294c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091291:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.091293:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.091296:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.091296:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.091415:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601705.091874:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789601705.091881:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091890:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789601705.091893:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601705.091898:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091907:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091916:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091923:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.091953:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601705.092400:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601705.092407:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.092415:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3466800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.092418:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.092433:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.092463:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.092471:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a8b322f/0x74872e3eca9f2953 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.092489:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.092491:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.092492:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.094831:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.094843:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.094857:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.094861:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.094867:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.094880:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.094890:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.094898:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.094925:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601705.095108:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601705.095114:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.095123:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.095127:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.095136:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.095153:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.095173:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015dedc39/0x74872e3eca9f295a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.095192:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.095194:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.095196:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.095548:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.095572:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.095582:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.095586:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.095590:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.095614:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.095623:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.095630:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.095654:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789601705.095942:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.095949:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096059:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.096063:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.096067:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096077:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096086:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096105:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096119:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789601705.096127:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601705.096132:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096139:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.096143:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096151:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096162:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096267:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008843ffa1/0x74872e3eca9f2961 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096282:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601705.096285:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096302:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737ca00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.096306:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096313:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096323:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096330:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c644f100/0x74872e3eca9f2968 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096341:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.096343:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.096344:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.096394:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.096708:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.096714:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096723:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.096726:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.096731:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096740:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096754:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096772:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.096789:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789601705.097063:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.097069:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097078:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.097081:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.097085:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097094:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097101:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097108:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097132:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789601705.097139:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601705.097144:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097151:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.097154:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097159:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601705.097164:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097171:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737dc00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.097174:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097182:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097194:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097201:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ccb3e1/0x74872e3eca9f2976 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.097215:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.097217:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.097224:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.097344:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097364:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097371:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd68fc24/0x74872e3eca9f296f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097384:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.097385:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.097387:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.097715:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.097721:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097729:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.097736:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.097740:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097749:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097815:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097824:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.097844:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601705.098108:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601705.098113:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098122:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737de00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.098126:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098133:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098146:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098154:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fe8f7f/0x74872e3eca9f297d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098167:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.098169:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.098171:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.098435:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.098442:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098450:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.098454:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.098458:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098467:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098475:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098488:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098508:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601705.098526:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601705.098531:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098538:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.098541:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098576:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098588:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098595:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e34ca5/0x74872e3eca9f2984 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.098609:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.098611:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601705.098612:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.098923:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.098929:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098938:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.098941:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.098946:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.098955:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.099025:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.099033:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.099079:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789601705.104239:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.104263:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.104295:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.104299:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.104305:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.104320:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.104329:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.104337:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104467:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601705.104475:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104483:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.104488:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104496:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104514:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104522:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a2d4a70/0x74872e3eca9f298b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104543:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.104546:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104552:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.104568:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104592:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104602:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.104610:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.104612:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.104614:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.104713:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789601705.104718:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f2992 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601705.106146:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.106157:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.106169:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.106173:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.106178:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.106205:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.106215:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.106222:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.106283:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.106290:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.106297:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.106301:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.106309:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.106324:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.106333:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.106334:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.106336:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.106859:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789601705.106866:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2999 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601705.108052:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.108063:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.108848:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.108855:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.108862:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.108877:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.108903:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.108911:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109175:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.109183:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109191:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.109196:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109205:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109220:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109228:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.109230:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.109231:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.109292:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789601705.109298:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.109589:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601705.109767:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601705.109775:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.109784:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1789601705.109788:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601705.109792:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.109801:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.109809:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.109823:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.109843:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.110263:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.110268:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110277:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.110281:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110289:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110313:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110321:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038955b34/0x74872e3eca9f29a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110344:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.110346:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.110348:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601705.110449:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601705.110455:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.110463:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1789601705.110466:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601705.110470:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.110478:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.110485:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.110491:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.110512:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601705.110585:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601705.110591:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110598:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601705.110601:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110609:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110621:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110628:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a265098/0x74872e3eca9f29ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.110653:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.110655:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.110656:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.111480:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.111488:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.111498:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.111501:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.111505:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.111516:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.111526:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.111542:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.111577:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789601705.112165:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.112172:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.112181:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.112184:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.112188:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.112197:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.112206:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.112213:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.112232:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789601705.112639:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601705.112646:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112662:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601705.112666:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112675:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112693:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112702:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d3fca9/0x74872e3eca9f29b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112721:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601705.112724:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112730:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601705.112734:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112742:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112751:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112763:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000376977e9/0x74872e3eca9f29bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112775:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.112776:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.112778:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601705.112911:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601705.112917:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112926:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789601705.112929:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601705.112934:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112944:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112952:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.112959:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.113009:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789601705.113392:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601705.113403:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.113412:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789601705.113415:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601705.113418:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.113427:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.113435:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.113443:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121184:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601705.121199:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121227:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.121232:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121253:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121275:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121283:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab36da5/0x74872e3eca9f29c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121303:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601705.121307:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121322:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601705.121326:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121334:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121343:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.121356:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.121358:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.121360:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.127276:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789601705.127293:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003110fdf7/0x74872e3eca9f29ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.127774:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601705.129346:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601705.129358:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.129374:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789601705.129378:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601705.129384:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.129398:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.129409:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.129417:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.129442:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789601705.129501:0:18553:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1789601705.129608:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17070:x1876532918425216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77602us (77717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.129629:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601705.129688:0:17070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17070:1876532918425216:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789601705.129703:0:17070:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789601705.129744:0:17070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17070:1876532918425344:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789601705.129775:0:17070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.129800:0:17070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d8245240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601705.129819:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425344 00000100:00100000:2.0:1789601705.129825:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425344 00000100:00100000:2.0:1789601705.129861:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789601705.129863:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789601705.129869:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17070:x1876532918425344:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789601705.129870:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.129879:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601705.129882:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.129897:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789601705.129902:0:19127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1789601705.129912:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.129919:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc759a80/0x74872e3eca9f29d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.129937:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.129939:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.129941:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601705.131020:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789601705.142943:0:18548:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789601705.142982:0:18548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789601705.143240:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17070:x1876532918425344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13367us (13459us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789601705.143260:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601705.149734:0:17070:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789601705.149750:0:17070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17070:1876532918425344:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789601705.149768:0:17070:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:01000004:3.0:1789601705.691515:0:19365:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789601705.691520:0:19365:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789601705.691521:0:19365:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789601705.691650:0:19365:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df4eaba5800 00000020:01000004:3.0:1789601705.691677:0:19365:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789601705.691691:0:19365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789601705.691704:0:19365:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df4f7350000) 00000020:00000080:3.0:1789601705.691721:0:19365:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789601705.744307:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789601705.747470:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789601705.748193:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789601705.748499:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789601705.749023:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789601705.749454:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789601705.749847:0:19365:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789601705.756803:0:19365:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789601705.757083:0:19365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789601705.757098:0:19365:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789601705.757111:0:19365:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74872e3eca9f29df 00000020:01000004:3.0:1789601705.757119:0:19365:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789601705.757140:0:19365:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789601705.757143:0:19365:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789601705.757149:0:19365:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789601705.757176:0:19365:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789601705.757180:0:19365:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789601705.798546:0:19365:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789601705.798628:0:19365:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789601705.798633:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789601705.798635:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789601705.798637:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601705.798638:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601705.798640:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601705.798641:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601705.798643:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601705.798644:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601705.798646:0:19365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601705.798650:0:19365:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789601705.798653:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601705.798654:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789601705.798655:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601705.798656:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601705.798657:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601705.798658:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601705.798659:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601705.798661:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601705.798662:0:19365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601705.798694:0:19365:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789601705.798717:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789601705.798805:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.798849:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601705.798969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601705.798982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918425600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601705.799015:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.799162:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425472 00000100:00100000:0.0:1789601705.799170:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425472 00000100:00100000:0.0:1789601705.799222:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601705.799232:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:19365:x1876532918425472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789601705.799271:0:17039:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789601705.799275:0:17039:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789601705.799279:0:17039:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789601705.799388:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425600 00000100:00100000:0.0:1789601705.799393:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425600 00000100:00100000:0.0:1789601705.799422:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601705.799429:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918425600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789601705.799453:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789601705.799500:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918425600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.799507:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601705.799550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918425600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601705.799955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601705.799966:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918425728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601705.799998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.800054:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425728 00000100:00100000:1.0:1789601705.800058:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425728 00000100:00100000:1.0:1789601705.800091:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601705.800099:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918425728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601705.800116:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601705.800159:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918425728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.800165:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601705.800221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918425728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601705.800749:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:19365:x1876532918425472:12345-0@lo:253:mount.lustre.0 Request processed in 1518us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.800769:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601705.800904:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601705.800930:0:19365:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789601705.800933:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601705.800934:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601705.800935:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601705.800937:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601705.800938:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601705.800939:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601705.800940:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601705.800942:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601705.800943:0:19365:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789601705.800959:0:19365:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df4eaba5800 from lustre-OST0001 10000000:01000000:0.0:1789601705.800983:0:19365:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789601705.800986:0:19365:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789601705.800995:0:19365:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df4f7638000 local copy 00010000:00010000:0.0:1789601705.801004:0:19365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601705.801093:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601705.801122:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.801153:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601705.801213:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425856 00000100:00100000:1.0:1789601705.801218:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425856 00000100:00100000:1.0:1789601705.801260:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601705.801268:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:19365:x1876532918425856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601705.801335:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:19365:x1876532918425856:12345-0@lo:501:mount.lustre.0 Request processed in 68us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601705.801342:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789601705.801634:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425856:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789601705.801650:0:19365:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789601705.801667:0:19365:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789601705.801673:0:19365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.801681:0:19365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f73ee000/0x74872e3eca9f262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2635 expref: -99 pid: 17024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601705.801706:0:19365:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df4eaba5800 10000000:01000000:0.0:1789601705.801717:0:19365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789601705.801723:0:19365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789601705.801725:0:19365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601705.801730:0:19365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789601705.801733:0:19365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789601705.802648:0:19365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.802662:0:19365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.802672:0:19365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601705.802695:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601705.802745:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.802903:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.808472:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918425984 00000100:00100000:3.0:1789601705.808487:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918425984 00000100:00100000:0.0:1789601705.808695:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789601705.808707:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+21:19365:x1876532918425984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601705.808726:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601705.808744:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467200/0x74872e3eca9f29ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f29e6 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.808949:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467200/0x74872e3eca9f29ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f29e6 expref: 22 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.808961:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467200/0x74872e3eca9f29ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f29e6 expref: 22 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.808970:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467200, rc 0) 00000100:00100000:0.0:1789601705.809061:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918425984:12345-0@lo:101:mount.lustre.0 Request processed in 357us (6315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.809068:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789601705.809156:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918425984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601705.809175:0:19365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f29ed expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.809185:0:19365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f29ed expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601705.816894:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789601705.817539:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601705.835421:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789601705.835507:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789601705.835528:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789601705.835545:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789601705.835614:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789601705.835630:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789601705.835666:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789601705.835672:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789601705.837281:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601705.837379:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.837451:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.837617:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426112 00000100:00100000:0.0:1789601705.837629:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426112 00000100:00100000:0.0:1789601705.837704:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789601705.837716:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601705.839231:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426112:12345-0@lo:501:mount.lustre.0 Request processed in 1509us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.839256:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789601705.839488:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601705.839550:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601705.839641:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.839669:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.839732:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426240 00000100:00100000:0.0:1789601705.839740:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426240 00000100:00100000:0.0:1789601705.840026:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601705.840039:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601705.842224:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426240:12345-0@lo:503:mount.lustre.0 Request processed in 2179us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.842250:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789601705.842421:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789601705.844299:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789601705.844427:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601705.844531:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.844680:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.844872:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426368 00000100:00100000:0.0:1789601705.845013:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426368 00000100:00100000:0.0:1789601705.845205:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789601705.845219:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601705.846086:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601705.846364:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789601705.846398:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789601705.846415:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789601705.846430:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789601705.846443:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789601705.846457:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789601705.846470:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789601705.846484:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789601705.846498:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789601705.846535:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601705.846651:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.847047:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426368:12345-0@lo:502:mount.lustre.0 Request processed in 1829us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.847060:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789601705.847651:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426496 00000100:00100000:0.0:1789601705.847661:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426496 00000100:00100000:0.0:1789601705.847716:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601705.847735:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601705.848256:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426496:12345-0@lo:502:mount.lustre.0 Request processed in 523us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.848264:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789601705.848542:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f8bf8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.848680:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601705.849003:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789601705.849021:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789601705.850317:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789601705.850329:0:19369:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789601705.850338:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.850340:0:19369:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789601705.850351:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601705.850372:0:19369:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df4f37219c0) 00000020:00000080:0.0:1789601705.850406:0:19369:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789601705.850414:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789601705.850540:0:19369:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4eaba5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789601705.850552:0:19369:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789601705.850750:0:19369:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x74872e3eca9f29fb 00010000:00010000:0.0:1789601705.858312:0:19369:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789601705.859521:0:19369:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789601705.863485:0:19369:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789601705.866645:0:19369:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789601705.866661:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.866670:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.866672:0:19369:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789601705.866675:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.866680:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.866682:0:19369:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789601705.866686:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789601705.866688:0:19369:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789601705.866690:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.866693:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.866694:0:19369:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789601705.866697:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.866713:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.866714:0:19369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789601705.866719:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789601705.866773:0:19369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.866777:0:19369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.866778:0:19369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789601705.866792:0:19369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789601705.867316:0:19365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789601705.867360:0:19365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789601705.867390:0:19365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f29ed expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.867407:0:19365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df3c3467000/0x74872e3eca9f29e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f29ed expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601705.867418:0:19365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4eaba5800 from 1 10000000:01000000:3.0:1789601705.867421:0:19365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601705.867474:0:19365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.867499:0:19365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.867515:0:19365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601705.867552:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601705.867685:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.867738:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.868257:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426624 00000100:00100000:0.0:1789601705.868267:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426624 00000100:00100000:0.0:1789601705.868344:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789601705.868355:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918426624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601705.868373:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601705.868389:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2a02 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.868419:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.868431:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601705.868440:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466e00, rc 0) 00000100:00100000:0.0:1789601705.868499:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918426624:12345-0@lo:101:mount.lustre.0 Request processed in 146us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.868506:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789601705.868639:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601705.868658:0:19365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.868669:0:19365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601705.871215:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789601705.871707:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601705.872379:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789601705.872411:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789601705.872432:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789601705.872438:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789601705.872546:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601705.874153:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.875893:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.880728:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426752 00000100:00100000:0.0:1789601705.880749:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426752 00000100:00100000:0.0:1789601705.881202:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601705.881215:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918426752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601705.881443:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918426752:12345-0@lo:501:mount.lustre.0 Request processed in 231us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.881458:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789601705.882353:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601705.882421:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601705.882484:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.884370:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601705.884437:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918426880 00000100:00100000:1.0:1789601705.884448:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918426880 00000100:00100000:1.0:1789601705.884498:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789601705.884506:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918426880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601705.884699:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918426880:12345-0@lo:503:mount.lustre.0 Request processed in 193us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.884707:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789601705.884933:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918426880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601705.885488:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601705.885598:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601705.885652:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.885674:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601705.885973:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427008 00000100:00100000:1.0:1789601705.885979:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427008 00000100:00100000:1.0:1789601705.886009:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789601705.886017:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918427008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601705.886210:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918427008:12345-0@lo:502:mount.lustre.0 Request processed in 193us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.886217:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789601705.886349:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601705.886527:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789601705.886550:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789601705.886591:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789601705.886604:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789601705.886615:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789601705.886626:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789601705.886637:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789601705.886647:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789601705.886658:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789601705.886669:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789601705.886679:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789601705.886700:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601705.886733:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.886935:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427136 00000100:00100000:1.0:1789601705.886940:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427136 00000100:00100000:1.0:1789601705.887227:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601705.887235:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918427136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601705.887336:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918427136:12345-0@lo:502:mount.lustre.0 Request processed in 102us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.887343:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789601705.887457:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.887476:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601705.887530:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789601705.887541:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789601705.889485:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.889503:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889506:0:19373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789601705.889514:0:19373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4eaba5800 00000020:00000080:0.0:1789601705.889518:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601705.889528:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.889531:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889532:0:19373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789601705.889534:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.889537:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889538:0:19373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789601705.889541:0:19373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df4eaba5800 00000020:00000080:0.0:1789601705.889544:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601705.889654:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.889658:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889659:0:19373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789601705.889661:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.889663:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889664:0:19373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601705.889666:0:19373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4eaba5800 00000020:00000080:0.0:1789601705.889667:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601705.889680:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.889681:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889682:0:19373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789601705.889683:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601705.889685:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889686:0:19373:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789601705.889688:0:19373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df4eaba5800 00000020:00000080:0.0:1789601705.889689:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789601705.889702:0:19373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601705.889705:0:19373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601705.889730:0:19373:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789601705.889733:0:19373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789601705.891302:0:19365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789601705.891357:0:19365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601705.891390:0:19365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.891406:0:19365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601705.891481:0:19365:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789601705.891484:0:19365:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df4eaba5800 10000000:01000000:3.0:1789601705.891487:0:19365:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df4eaba5800 10000000:01000000:3.0:1789601705.891492:0:19365:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601705.891500:0:19365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df4eaba5800 from 1 10000000:01000000:3.0:1789601705.891503:0:19365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601705.891551:0:19365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.891579:0:19365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.891593:0:19365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601705.891623:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601705.891704:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.891766:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601705.891896:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427264 00000100:00100000:2.0:1789601705.891904:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427264 00000100:00100000:2.0:1789601705.892196:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789601705.892208:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+23:19365:x1876532918427264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601705.892226:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601705.892251:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f2a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2a10 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.892280:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f2a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2a10 expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.892291:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4c0031800/0x74872e3eca9f2a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2a10 expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.892301:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4c0031800, rc 0) 00000100:00100000:2.0:1789601705.892355:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427264:12345-0@lo:101:mount.lustre.0 Request processed in 150us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.892363:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601705.893196:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601705.893219:0:19365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a17 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.893231:0:19365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2a17 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601705.895045:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789601705.896443:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601705.896788:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789601705.900879:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789601705.900935:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789601705.901197:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789601705.901213:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789601705.901226:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789601705.901248:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789601705.901262:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789601705.901273:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789601705.901297:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789601705.901309:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789601705.901320:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789601705.901330:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789601705.901341:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789601705.901352:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789601705.901362:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789601705.901373:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789601705.901384:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789601705.901394:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789601705.901405:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789601705.901416:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789601705.901426:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789601705.901436:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789601705.901448:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789601705.901458:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789601705.901485:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789601705.901497:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789601705.901508:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789601705.901518:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789601705.901529:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789601705.901539:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789601705.901550:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789601705.901581:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789601705.901593:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789601705.901604:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789601705.901614:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789601705.901625:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789601705.901635:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789601705.901646:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789601705.901656:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789601705.901667:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789601705.901689:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789601705.901706:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789601705.901717:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789601705.901728:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789601705.901739:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789601705.901776:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789601705.901782:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789601705.904215:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601705.904317:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.904374:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4368180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601705.905904:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427392 00000100:00100000:0.0:1789601705.905919:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427392 00000100:00100000:0.0:1789601705.905998:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789601705.906011:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601705.906225:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427392:12345-0@lo:501:mount.lustre.0 Request processed in 217us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.906234:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601705.907132:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601705.907197:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601705.907273:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.907322:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4368180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.907815:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427520 00000100:00100000:3.0:1789601705.907824:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427520 00000100:00100000:3.0:1789601705.907879:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789601705.907891:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601705.908029:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427520:12345-0@lo:503:mount.lustre.0 Request processed in 140us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.908045:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789601705.908503:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789601705.909315:0:19365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601705.910830:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601705.910937:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.913365:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c4368b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.914481:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427648 00000100:00100000:3.0:1789601705.914497:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427648 00000100:00100000:3.0:1789601705.914623:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789601705.914635:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601705.915529:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427648:12345-0@lo:502:mount.lustre.0 Request processed in 892us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.915540:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789601705.916068:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601705.916367:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789601705.916403:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789601705.916418:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789601705.916431:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789601705.916445:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789601705.916459:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789601705.916470:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789601705.916481:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789601705.916519:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789601705.916533:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789601705.916545:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789601705.916578:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789601705.916594:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789601705.916608:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789601705.916620:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789601705.916634:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789601705.916647:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789601705.916659:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789601705.916671:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789601705.916682:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789601705.916694:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789601705.916707:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789601705.916720:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789601705.916734:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789601705.918377:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789601705.918434:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789601705.918450:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789601705.918463:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789601705.918474:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789601705.918489:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789601705.918504:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789601705.918516:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789601705.918531:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789601705.918547:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789601705.918588:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789601705.918604:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789601705.918615:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789601705.918626:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789601705.918636:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789601705.918648:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789601705.918679:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789601705.918705:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789601705.918720:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789601705.918733:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789601705.918745:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789601705.919386:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789601705.919408:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789601705.919421:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789601705.920098:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601705.920204:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.920308:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601705.920449:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427776 00000100:00100000:1.0:1789601705.920459:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427776 00000100:00100000:1.0:1789601705.920587:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601705.920599:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601705.920774:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427776:12345-0@lo:502:mount.lustre.0 Request processed in 176us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.920792:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789601705.920905:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601705.921160:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789601705.921188:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789601705.921223:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601705.921277:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.921602:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.921653:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918427904 00000100:00100000:3.0:1789601705.921659:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918427904 00000100:00100000:3.0:1789601705.921693:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789601705.921701:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601705.921951:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918427904:12345-0@lo:502:mount.lustre.0 Request processed in 244us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.921959:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789601705.922148:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918427904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601705.922207:0:19365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789601705.922217:0:19365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789601705.924036:0:19378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789601705.924059:0:19378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df4fb6f99c0) 00000020:00000080:1.0:1789601705.924091:0:19378:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789601705.924198:0:19378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4eaba5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789601705.924203:0:19378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4eaba5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789601705.924206:0:19378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4eaba5800 3 00010000:00080000:1.0:1789601705.924260:0:19378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df3c3105800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1789601705.927204:0:19378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789601705.927471:0:19378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789601705.927534:0:19378:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601705.927552:0:19378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x74872e3eca9f2a25 00000100:00080000:2.0:1789601705.927595:0:19378:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601705.927610:0:19378:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df3c3105800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601705.927655:0:19378:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4cd0bad80 x1876532918428032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601705.927684:0:19378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789601705.928051:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918428032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789601705.928209:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.928297:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428032 00000100:00100000:1.0:1789601705.928307:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428032 00000100:00100000:1.0:1789601705.928347:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601705.928357:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876532918428032:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789601705.928389:0:17046:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1789601705.928427:0:17046:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x74872e3eca9f2a2c 00000004:00100000:1.0:1789601705.928444:0:17046:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601705.928482:0:17046:0:(import.c:65:import_set_state_nolock()) ffff8df3c3102800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601705.928551:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876532918428032:12345-0@lo:38:llog_process_th.0 Request processed in 194us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.928581:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789601705.928630:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4cd0bad80 x1876532918428032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601705.928642:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601705.928651:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789601705.928659:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789601705.928664:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789601705.928666:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c3105800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789601705.928673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876532918428032:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789601705.928963:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601705.928969:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601705.928971:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601705.928976:0:1385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:2.0:1789601705.928979:0:1385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789601705.928987:0:1385:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601705.929004:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ad500 x1876532918428416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601705.929038:0:1385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601705.929041:0:1385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601705.929048:0:1385:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601705.929052:0:1385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 573 00000100:00080000:2.0:1789601705.929055:0:1385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789601705.929061:0:1385:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601705.929073:0:1385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36af480 x1876532918428928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601705.929118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918428160:0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929162:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.929188:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918428800:0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.929236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789601705.929252:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918428672:0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929276:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.929293:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918429312:0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.929344:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428160 00000100:00100000:2.0:1789601705.929350:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428160 00000100:00100000:2.0:1789601705.929380:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428672 00000100:00100000:2.0:1789601705.929383:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428672 00000100:00100000:2.0:1789601705.929395:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601705.929403:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929450:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918428160:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.929456:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601705.929472:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789601705.929477:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929514:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918428672:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.929519:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789601705.929542:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429312 00000100:00100000:2.0:1789601705.929546:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429312 00000100:00100000:2.0:1789601705.929596:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601705.929604:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918429312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929636:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918429312:12345-0@lo:400:kworker.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.929642:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601705.929671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918428672:0@lo:400:kworker.0 00010000:00080000:2.0:1789601705.929683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c36afb80 x1876532918429312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601705.929693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918429312:0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.929702:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918428160:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.929906:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918428544:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.929941:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.929963:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918429184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.929990:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.930016:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918428416:0@lo:8:kworker.0 00000100:00100000:2.0:1789601705.930046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601705.930090:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601705.930096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918428288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.930126:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428544 00000100:00100000:3.0:1789601705.930130:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428544 00000100:00100000:3.0:1789601705.930153:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429184 00000100:00100000:3.0:1789601705.930155:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429184 00000100:00100000:3.0:1789601705.930169:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601705.930181:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918428544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.930228:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918428544:12345-0@lo:400:kworker.0 Request processed in 48us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.930234:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601705.930260:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601705.930267:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918429184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.930308:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876532918429184:12345-0@lo:400:kworker.0 Request processed in 42us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.930315:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601705.931687:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918428928:0@lo:8:kworker.0 00000100:00100000:3.0:1789601705.931790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601705.932017:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428800 00000100:00100000:0.0:1789601705.932027:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428800 00000100:00100000:0.0:1789601705.932207:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428416 00000100:00100000:0.0:1789601705.932212:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428416 00000100:00100000:0.0:1789601705.932235:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601705.932258:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.932321:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918428800:12345-0@lo:400:kworker.0 Request processed in 67us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.932329:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601705.932346:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601705.932351:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918428416:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789601705.932883:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918428416:12345-0@lo:8:kworker.0 Request processed in 529us (2834us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789601705.932890:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601705.932939:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918428800:0@lo:400:kworker.0 00000020:01000004:2.0:1789601705.933221:0:19378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789601705.933249:0:19378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8df4f8d919c0) 00000020:00000080:2.0:1789601705.933274:0:19378:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789601705.933396:0:19378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df4eaba5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601705.933401:0:19378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df4eaba5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601705.933405:0:19378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df4eaba5800 3 00010000:00080000:2.0:1789601705.933437:0:19378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df4d878b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.148@tcp at head 00000100:00100000:2.0:1789601705.934892:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428288 00000100:00100000:2.0:1789601705.934907:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428288 00000100:00100000:2.0:1789601705.936360:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601705.936379:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918428288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601705.940453:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918428288:12345-0@lo:400:kworker.0 Request processed in 4062us (8644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.940474:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601705.941094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918428288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.941111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918429056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601705.941173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789601705.941217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c36af800 x1876532918428544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601705.941230:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918428544:0@lo:400:kworker.0 00010000:00080000:3.0:1789601705.941252:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c36ad180 x1876532918429184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601705.941261:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876532918429184:0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.941520:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429056 00000100:00100000:0.0:1789601705.941529:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429056 00000100:00100000:0.0:1789601705.941615:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601705.941625:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918429056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601705.941724:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876532918429056:12345-0@lo:400:kworker.0 Request processed in 99us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601705.941731:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789601705.942457:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df3c36ac700 x1876532918429056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601705.942471:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876532918429056:0@lo:400:kworker.0 00010000:00010000:2.0:1789601705.944315:0:19378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:1.0:1789601705.948211:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.948369:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601705.948380:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601705.948386:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789601705.948391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918428416:0@lo:8:kworker.0 00000020:00000080:3.0:1789601705.948621:0:19378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789601705.948692:0:19378:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601705.948720:0:19378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x74872e3eca9f2a3a 00000100:00080000:3.0:1789601705.948730:0:19378:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601705.948741:0:19378:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df4d878b800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789601705.948872:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918428928 00000100:00100000:0.0:1789601705.948882:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918428928 00000100:00100000:0.0:1789601705.948928:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601705.948937:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918428928:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789601705.949282:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876532918428928:12345-0@lo:8:kworker.0 Request processed in 344us (1081us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789601705.949291:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601705.949334:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601705.949342:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601705.949346:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789601705.949350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918428928:0@lo:8:kworker.0 00000100:00100000:3.0:1789601705.950013:0:19378:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df4d09c6a00 x1876532918429440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601705.950144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918429440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601705.950212:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789601705.950403:0:19378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789601705.951300:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429440 00000100:00100000:3.0:1789601705.951313:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429440 00000100:00100000:3.0:1789601705.951367:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601705.951376:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876532918429440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789601705.951429:0:17046:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1789601705.951484:0:17046:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x74872e3eca9f2a41 00000004:00100000:3.0:1789601705.951513:0:17046:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789601705.951576:0:17046:0:(import.c:65:import_set_state_nolock()) ffff8df3c1b76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601705.951671:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876532918429440:12345-0@lo:38:llog_process_th.0 Request processed in 295us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.951679:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789601705.952089:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df4d09c6a00 x1876532918429440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601705.952103:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601705.952113:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789601705.952124:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789601705.952129:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789601705.952131:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4d878b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601705.952137:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876532918429440:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789601705.952545:0:19378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789601705.954164:0:19365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789601705.954208:0:19365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601705.954245:0:19365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a17 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.954265:0:19365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7382800/0x74872e3eca9f2a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a17 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789601705.954330:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789601705.954336:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789601705.954338:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601705.954339:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601705.954340:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601705.954341:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601705.954343:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601705.954345:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601705.954346:0:19365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601705.954350:0:19365:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789601705.954352:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601705.954353:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789601705.954355:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601705.954355:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601705.954356:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601705.954357:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601705.954358:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601705.954359:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601705.954360:0:19365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601705.954393:0:19365:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789601705.954417:0:19365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918429568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789601705.954515:0:19365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.954586:0:19365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43686c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.954728:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429568 00000100:00100000:3.0:1789601705.954738:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429568 00000100:00100000:3.0:1789601705.954809:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789601705.954820:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:19365:x1876532918429568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789601705.954855:0:17038:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789601705.954873:0:17038:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789601705.963009:0:17038:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789601705.963036:0:17038:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789601705.963151:0:17061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789601705.963157:0:17061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789601705.963185:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963207:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963215:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963223:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963297:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963314:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601705.963332:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918429696:0@lo:104: 00000100:00100000:1.0:1789601705.963415:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601705.963485:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.963502:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 24 pid: 17037 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601705.963513:0:17061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918429824:0@lo:104: 00000100:00100000:1.0:1789601705.963535:0:17061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.963594:0:17061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d98c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601705.963602:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429696 00000100:00100000:3.0:1789601705.963612:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429696 00000100:00100000:3.0:1789601705.963659:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429824 00000100:00100000:3.0:1789601705.963662:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429824 00000100:00100000:3.0:1789601705.963680:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601705.963690:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918429696:12345-0@lo:104: 00010000:00010000:3.0:1789601705.963712:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.963949:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601705.963957:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:17061:x1876532918429696:12345-0@lo:104: Request processed in 268us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.963965:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601705.963988:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601705.963994:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918429824:12345-0@lo:104: 00010000:00010000:3.0:1789601705.964002:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964135:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601705.964144:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964151:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:2.0:1789601705.964155:0:17800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964164:0:17800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601705.964172:0:17800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601705.964178:0:17800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601705.964224:0:17800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964253:0:17800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601705.964285:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964292:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f737c000/0x74872e3eca9f28f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28ff expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.964303:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.964305:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601705.964307:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601705.964334:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918429952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601705.964398:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3426a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918429696:0@lo:104: 00010000:00010000:3.0:1789601705.965819:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601705.965835:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:17061:x1876532918429824:12345-0@lo:104: Request processed in 1838us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.965848:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789601705.965899:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601705.965906:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.965916:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737da00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601705.965921:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.965931:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601705.965939:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601705.968327:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601705.968402:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601705.968409:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601705.968445:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601705.968453:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789601705.968466:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f737da00/0x74872e3eca9f28ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28f1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601705.968480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918430080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601705.968498:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.968500:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601705.968503:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601705.968577:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601705.968644:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430080 00000100:00100000:2.0:1789601705.968651:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430080 00000100:00100000:1.0:1789601705.968659:0:17061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17061:1876532918429824:0@lo:104: 00010000:00010000:2.0:1789601705.968687:0:17030:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 25 pid: 17037 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.968692:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601705.968720:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601705.968730:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+25:3646:x1876532918430080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601705.968745:0:17030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601705.968751:0:17030:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 25 pid: 17037 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.968762:0:17030:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 25 pid: 17037 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.968780:0:17030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f28f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f28ea expref: 25 pid: 17037 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601705.968804:0:17030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601705.968849:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3646:x1876532918430080:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601705.968857:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601705.968887:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918430080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601705.969981:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601705.970092:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918429952 00000100:00100000:1.0:1789601705.970100:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918429952 00010000:00010000:1.0:1789601705.970131:0:18578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601705.970188:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601705.970197:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918429952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601705.970210:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601705.970216:0:18578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970228:0:18578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970255:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737d200/0x74872e3eca9f28ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f28f8 expref: 24 pid: 17039 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970272:0:18578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970282:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789601705.970303:0:18578:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018102256s 00010000:00010000:1.0:1789601705.970308:0:18578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970317:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970324:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970332:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970345:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601705.970351:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970361:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970379:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970389:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601705.970432:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+23:3648:x1876532918429952:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601705.970440:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789601705.970466:0:17061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970475:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601705.970482:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f73ef400/0x74872e3eca9f2a48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601705.971043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918429952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601705.971253:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:19365:x1876532918429568:12345-0@lo:253:mount.lustre.0 Request processed in 16433us (16737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601705.971266:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601705.971365:0:19365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0068b5de-bd03-471c-817a-758c66ef4c46:19365:1876532918429568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789601705.971380:0:19365:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789601705.971383:0:19365:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601705.971385:0:19365:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789601705.971386:0:19365:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601705.971388:0:19365:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601705.971398:0:19365:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601705.971399:0:19365:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601705.971401:0:19365:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601705.971403:0:19365:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601705.971405:0:19365:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789601705.971419:0:19365:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789601705.986997:0:19365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789601705.995120:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789601706.011420:0:19365:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789601706.011435:0:19365:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789601706.011501:0:19365:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789601706.011976:0:19365:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789601706.012007:0:19365:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789601706.012051:0:19365:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789601706.015517:0:19365:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601706.017039:0:19365:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789601706.309758:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601706.309781:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918430208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601706.309849:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601706.309902:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430208 00000100:00100000:0.0:1789601706.309910:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430208 00000100:00100000:0.0:1789601706.309966:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601706.309976:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918430208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601706.309996:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789601706.310037:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918430208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601706.310043:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601706.310086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918430208:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789601707.017926:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789601707.020721:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601707.020728:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df4e01b3800 from 10 10000000:01000000:2.0:1789601707.020733:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601707.020774:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.020786:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.020797:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601707.020822:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601707.020885:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601707.020977:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601707.023451:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430336 00000100:00100000:0.0:1789601707.023464:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430336 00000100:00100000:0.0:1789601707.023577:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789601707.023587:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918430336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601707.023602:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601707.023628:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f2a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2a4f expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.023659:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f2a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2a4f expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.023669:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466200/0x74872e3eca9f2a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2a4f expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.023678:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466200, rc 0) 00000100:00100000:0.0:1789601707.023748:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918430336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601707.023755:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789601707.025271:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601707.025299:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a56 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.025311:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2a56 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601707.025377:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601707.025439:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601707.030076:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601707.036496:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430464 00000100:00100000:3.0:1789601707.036514:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430464 00000100:00100000:3.0:1789601707.036758:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789601707.036768:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918430464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789601707.036793:0:17037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789601707.036817:0:17037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789601707.036820:0:17037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789601707.037120:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918430464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 353us (11680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601707.037138:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789601707.048359:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789601707.048454:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601707.048464:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a56 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.048475:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c0030000/0x74872e3eca9f2a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a56 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601707.048487:0:17042:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601707.048490:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df3c41ab800 from 10 10000000:01000000:2.0:1789601707.048492:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601707.048528:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.048548:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.048572:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601707.048596:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601707.048656:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601707.048706:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601707.049436:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430592 00000100:00100000:0.0:1789601707.049445:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430592 00000100:00100000:0.0:1789601707.049508:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789601707.049519:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918430592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601707.049544:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601707.049574:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f2a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2a5d expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.049601:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f2a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2a5d expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.049612:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3467e00/0x74872e3eca9f2a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2a5d expref: 24 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.049621:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3467e00, rc 0) 00000100:00100000:0.0:1789601707.049679:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918430592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601707.049699:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789601707.051346:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601707.051371:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a64 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601707.051396:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2a64 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601707.051460:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601707.051514:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601707.051584:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f399f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601707.051643:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430720 00000100:00100000:0.0:1789601707.051650:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430720 00000100:00100000:0.0:1789601707.051699:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789601707.051708:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918430720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789601707.051725:0:17038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789601707.051740:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789601707.051743:0:17038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789601707.051836:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918430720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601707.051843:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789601707.051877:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918430720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789601707.051929:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601707.051936:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a64 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601707.051945:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4c0031a00/0x74872e3eca9f2a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2a64 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1789601707.083934:0:19432:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601707.084547:0:19432:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789601707.911290:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601708.037726:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601709.061703:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601710.086083:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601710.406985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918430848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601710.407078:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601710.407292:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430848 00000100:00100000:2.0:1789601710.407304:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430848 00000100:00100000:2.0:1789601710.407374:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601710.407385:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918430848:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789601710.407405:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789601710.407415:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601710.407496:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918430848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601710.407503:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601710.407631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918430848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601710.921442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918430976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789601710.921528:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601710.924732:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918430976 00000100:00100000:2.0:1789601710.924747:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918430976 00000100:00100000:2.0:1789601710.924796:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601710.924805:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918430976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601710.924839:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789601710.924915:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918430976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601710.924922:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789601710.924980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918431104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601710.925010:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601710.925049:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431104 00000100:00100000:2.0:1789601710.925052:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431104 00000100:00100000:2.0:1789601710.925068:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789601710.925073:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918431104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789601710.925088:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789601710.925114:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918431104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601710.925119:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789601710.925150:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918431104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601710.925174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918430976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601711.109888:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789601711.440039:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601711.440046:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601711.440050:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601711.440067:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df3c2b0f800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601711.440089:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ad180 x1876532918431488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601711.440172:0:13926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601711.440177:0:13926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601711.440179:0:13926:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601711.440185:0:13926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df4cd0f4000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789601711.440211:0:13926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df3c36ae680 x1876532918431872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601711.440274:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918431744:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440346:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440395:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918432384:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440427:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789601711.440455:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918431232:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440481:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440505:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918432000:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440521:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440536:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918432512:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440599:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918431360:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440638:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918432128:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440656:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789601711.440673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918431616:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440702:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918432256:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.440720:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440742:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918431488:0@lo:8:kworker.0 00000100:00100000:2.0:1789601711.440762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440785:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918431872:0@lo:8:kworker.0 00000100:00100000:2.0:1789601711.440804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.440839:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431744 00000100:00100000:2.0:1789601711.440847:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431744 00000100:00100000:2.0:1789601711.440895:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431360 00000100:00100000:2.0:1789601711.440904:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431360 00000100:00100000:2.0:1789601711.440920:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431488 00000100:00100000:2.0:1789601711.440923:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431488 00000100:00100000:2.0:1789601711.440931:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431872 00000100:00100000:2.0:1789601711.440934:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431872 00000100:00100000:2.0:1789601711.440944:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601711.440953:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918431744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441004:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918431744:12345-0@lo:400:kworker.0 Request processed in 52us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441011:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601711.441029:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601711.441035:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918431360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441065:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918431360:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441071:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601711.441082:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601711.441087:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918431488:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789601711.441125:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:2.0:1789601711.441152:0:18552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x74872e3eca9f2a6b 00002000:00100000:2.0:1789601711.441164:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df4d878f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789601711.441168:0:18552:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789601711.441171:0:18552:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789601711.441341:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789601711.441363:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df4d878e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601711.441397:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876532918431488:12345-0@lo:8:kworker.0 Request processed in 309us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441404:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601711.441423:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601711.441426:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876532918431872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789601711.441441:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:2.0:1789601711.441456:0:18552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x74872e3eca9f2a72 00002000:00100000:2.0:1789601711.441462:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8df4d8788800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789601711.441465:0:18552:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789601711.441467:0:18552:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789601711.441486:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789601711.441497:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df4d878c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601711.441523:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876532918431872:12345-0@lo:8:kworker.0 Request processed in 95us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441529:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601711.441550:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432384 00000100:00100000:2.0:1789601711.441574:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432384 00000100:00100000:2.0:1789601711.441596:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432000 00000100:00100000:2.0:1789601711.441598:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432000 00000100:00100000:2.0:1789601711.441607:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432512 00000100:00100000:2.0:1789601711.441609:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432512 00000100:00100000:2.0:1789601711.441621:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432128 00000100:00100000:2.0:1789601711.441623:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432128 00000100:00100000:2.0:1789601711.441636:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431616 00000100:00100000:2.0:1789601711.441638:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431616 00000100:00100000:2.0:1789601711.441649:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432256 00000100:00100000:2.0:1789601711.441651:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432256 00000100:00100000:2.0:1789601711.441664:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601711.441670:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918432384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441702:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918432384:12345-0@lo:400:kworker.0 Request processed in 31us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441708:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601711.441728:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601711.441735:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441764:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918432000:12345-0@lo:400:kworker.0 Request processed in 29us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441769:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601711.441781:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601711.441786:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918432512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441810:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918432512:12345-0@lo:400:kworker.0 Request processed in 24us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441815:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601711.441826:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601711.441831:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918432128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441855:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918432128:12345-0@lo:400:kworker.0 Request processed in 24us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441861:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601711.441872:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601711.441878:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918431616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441902:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918431616:12345-0@lo:400:kworker.0 Request processed in 26us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441907:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789601711.441917:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601711.441923:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918432256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.441945:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876532918432256:12345-0@lo:400:kworker.0 Request processed in 23us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.441951:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601711.441979:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918431232 00000100:00100000:2.0:1789601711.441982:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918431232 00000100:00100000:2.0:1789601711.442008:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789601711.442013:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:3645:x1876532918431232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.442042:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:3645:x1876532918431232:12345-0@lo:400:kworker.0 Request processed in 29us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.442048:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1789601711.442103:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36ad180 x1876532918431488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789601711.442117:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789601711.442124:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789601711.442130:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789601711.442132:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df3c2b0f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789601711.442151:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789601711.442158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876532918431488:0@lo:8:kworker.0 00010000:00080000:2.0:1789601711.442171:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36ae680 x1876532918431872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789601711.442181:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789601711.442186:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789601711.442189:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789601711.442191:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8df4cd0f4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789601711.442216:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789601711.442220:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876532918431872:0@lo:8:kworker.0 00000100:00100000:1.0:1789601711.442238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601711.442252:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918432640:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789601711.442266:0:17072:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789601711.442285:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17072:1876532918432896:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789601711.442311:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601711.442328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.442339:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c43686c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601711.442366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918432768:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789601711.442369:0:17789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789601711.442389:0:17789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433152:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789601711.442396:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.442422:0:17789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601711.442435:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432640 00000100:00100000:1.0:1789601711.442440:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432640 00000100:00100000:2.0:1789601711.442441:0:17789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c34b8180 going to sleep for 11 seconds 00000004:00080000:2.0:1789601711.442459:0:17788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789601711.442461:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432768 00000100:00100000:1.0:1789601711.442464:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432768 00000100:00100000:1.0:1789601711.442478:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601711.442485:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918432640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601711.442499:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000004:00080000:2.0:1789601711.442531:0:17788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 579563973233ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789601711.442539:0:17788:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789601711.442542:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918432640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601711.442551:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601711.442593:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601711.442594:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918432896 00000100:00100000:2.0:1789601711.442600:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918432896 00000100:00100000:1.0:1789601711.442613:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918432768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601711.442624:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433152 00000100:00100000:2.0:1789601711.442629:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433152 00002000:00000024:1.0:1789601711.442629:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601711.442650:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601711.442660:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17072:x1876532918432896:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789601711.442665:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876532918432768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601711.442672:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789601711.442881:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36af800 x1876532918431616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.442892:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918431616:0@lo:400:kworker.0 00010000:00080000:2.0:1789601711.442903:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a7b80 x1876532918432256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.442911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876532918432256:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.442921:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918431360:0@lo:400:kworker.0 00010000:00080000:2.0:1789601711.442930:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a5500 x1876532918432128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.442937:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918432128:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.442962:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918433024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601711.442992:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.443014:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918431232:0@lo:400:kworker.0 00010000:00080000:2.0:1789601711.443024:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36aca80 x1876532918432000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.443032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918432000:0@lo:400:kworker.0 00010000:00080000:2.0:1789601711.443041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6680 x1876532918432512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.443049:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918432512:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.443059:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918431744:0@lo:400:kworker.0 00010000:00080000:2.0:1789601711.443069:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a4700 x1876532918432384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.443076:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918432384:0@lo:400:kworker.0 00000100:00100000:2.0:1789601711.443104:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601711.443111:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17789:x1876532918433152:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789601711.443499:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433024 00000100:00100000:1.0:1789601711.443505:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433024 00000100:00100000:1.0:1789601711.443543:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601711.443549:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876532918433024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601711.443576:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789601711.443617:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876532918433024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601711.443624:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789601711.443657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a4a80 x1876532918432768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601711.443674:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918432768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601711.443689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918432640:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789601711.443738:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6300 x1876532918433024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601711.443752:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918433024:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1789601711.445043:0:17778:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:3.0:1789601711.445283:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601711.445289:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601711.445292:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601711.445294:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789601711.445304:0:17071:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789601711.445379:0:17071:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 579566822107ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789601711.445386:0:17071:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789601711.447143:0:17025:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789601711.458805:0:18553:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789601711.458816:0:18553:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789601711.458823:0:18553:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:2.0:1789601711.461578:0:18552:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789601711.461589:0:18552:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789601711.461693:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17789:x1876532918433152:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18578us (19268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.461703:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789601711.462766:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36ae680 x1876532918433152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601727 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601711.462783:0:17789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433152:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789601711.462797:0:17789:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789601711.462837:0:17789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433280:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789601711.462879:0:17789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601711.462915:0:17789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601711.462974:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433280 00000100:00100000:2.0:1789601711.462981:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433280 00000100:00100000:2.0:1789601711.463029:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601711.463038:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17789:x1876532918433280:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789601711.463078:0:18554:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789601711.463112:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17789:x1876532918433280:12345-0@lo:5:osp-pre-1-1.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.463119:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789601711.463187:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4d09c7800 x1876532918433280/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601727 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601711.463215:0:17789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433280:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789601711.463225:0:17789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789601711.463248:0:17789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433408:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789601711.463278:0:17789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601711.463301:0:17789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601711.463346:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433408 00000100:00100000:2.0:1789601711.463350:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433408 00000100:00100000:2.0:1789601711.463381:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601711.463388:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17789:x1876532918433408:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789601711.463412:0:18552:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1789601711.478411:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.478422:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.478440:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.478444:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.478450:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.478474:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.478485:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.478493:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.478591:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.481636:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.481650:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.481663:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.481669:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.481681:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.481704:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.481712:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2a79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.481734:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.481745:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.481747:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601711.485125:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.485137:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.485153:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.485159:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.485165:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.485179:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.485190:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.485210:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.485238:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789601711.486932:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.486944:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.486957:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.486961:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.486968:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.486988:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.486999:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487007:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487024:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789601711.487352:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601711.487360:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487370:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0031c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.487374:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487384:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487403:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487411:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d3fca9/0x74872e3eca9f2a80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487431:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601711.487435:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487441:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.487445:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487464:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487476:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487483:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a2d4a70/0x74872e3eca9f2a87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601711.487490:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601711.487498:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.487498:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.487501:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.487505:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.487510:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.487514:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.487518:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487527:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487534:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487631:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487645:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.487653:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.487657:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487664:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030c00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.487667:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487675:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487687:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487694:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bad19c8c/0x74872e3eca9f2a8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.487709:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.487711:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.487817:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.487902:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601711.489530:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.490195:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.490222:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.490227:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.490233:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.493061:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.493082:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.493091:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.493113:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601711.494043:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601711.494052:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.494062:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4c0030600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601711.494066:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.494077:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.494097:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.494116:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282c8d67/0x74872e3eca9f2a95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.494140:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.494142:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.494143:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.495294:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.495303:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.495316:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.495321:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.495326:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.495337:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.495348:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.495355:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.495373:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.495659:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.495665:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.495673:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.495678:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.495686:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.495709:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.495717:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2a9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.495741:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.495743:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.495745:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601711.496603:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.496611:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.496622:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.496626:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.496630:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.496640:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.496650:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.496658:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.496684:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601711.496856:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601711.496868:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.496875:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601711.496879:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.496888:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.496902:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.496910:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ae4b81/0x74872e3eca9f2aa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.496928:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.496929:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.496931:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789601711.498504:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.498514:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.498529:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.498532:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601711.498538:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.498551:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.498588:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.498596:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.498615:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601711.498780:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601711.498787:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.498794:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737da00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601711.498797:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.498816:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.498832:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.498839:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2aaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.498855:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.498858:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.498860:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601711.499170:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601711.499180:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.499192:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1789601711.499213:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601711.499219:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.499231:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.499240:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.499255:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.499276:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.499679:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.499685:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.499693:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382e00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.499703:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.499767:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.499784:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.499791:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef8b8ef/0x74872e3eca9f2ab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.499807:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.499809:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.499810:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601711.502324:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789601711.502336:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.502352:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1789601711.502357:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601711.502362:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.502375:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.502385:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.502392:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.502415:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601711.503521:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601711.503530:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.503540:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601711.503545:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.503583:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.503604:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.503624:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe4ad9c/0x74872e3eca9f2ab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.503645:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.503647:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.503649:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.504787:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.504797:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.504810:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.504814:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.504820:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.504831:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.504840:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.504846:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601711.505570:0:19366:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789601711.505593:0:19366:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789601711.505598:0:19366:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789601711.505835:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17789:x1876532918433408:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42444us (42552us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789601711.505845:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601711.505895:0:17789:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789601711.505902:0:17789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17789:1876532918433408:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789601711.505919:0:17789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789601711.505967:0:17789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17789:1876532918433536:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789601711.506000:0:17789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601711.506031:0:17789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d9872cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601711.506057:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433536 00000100:00100000:2.0:1789601711.506064:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433536 00000100:00100000:2.0:1789601711.506102:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601711.506110:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17789:x1876532918433536:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789601711.506158:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17789:x1876532918433536:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601711.506164:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789601711.506215:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c36aed80 x1876532918433536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789601727 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601711.506227:0:17789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17789:1876532918433536:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789601711.506632:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601711.507181:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.507196:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.507222:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.507227:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.507233:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.507246:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.507256:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.507264:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507531:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601711.507540:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507579:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.507584:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507594:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507611:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507619:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2abf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507643:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601711.507647:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507653:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.507657:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507665:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507674:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.507688:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.507690:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.507692:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.509169:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789601711.509178:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.509589:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.509735:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.509742:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.509754:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.509758:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.509769:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.509781:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.509791:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.509799:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.509818:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.510039:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.510046:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.510054:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.510059:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.510068:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.510082:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.510089:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2acd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.510110:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.510112:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.510114:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.510178:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.510183:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510191:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.510194:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.510209:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510218:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510225:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510244:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510289:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601711.510512:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.510518:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510526:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.510529:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.510533:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510542:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510550:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.510582:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510717:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601711.510724:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510731:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.510735:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510743:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510754:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510762:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2ad4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510777:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601711.510779:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510785:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:3.0:1789601711.510794:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510801:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510811:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601711.510817:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.510818:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.510820:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.513699:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789601711.513719:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2adb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601711.514956:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.514966:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.514981:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.514985:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.514991:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.515005:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.515015:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.515023:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.518974:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.518989:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.519004:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef600 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.519010:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.519021:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.519043:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.519056:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.519058:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.519060:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.525350:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789601711.525364:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036425b6e/0x74872e3eca9f2ae2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.525947:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.526351:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.526359:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.526385:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.526389:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.526395:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.526408:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.526419:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.526426:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.526451:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.526779:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.526787:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.526797:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ee800 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.526808:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.526818:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.526836:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.526844:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a265098/0x74872e3eca9f2ae9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.526859:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.526861:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.526863:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.526986:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.526993:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527002:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.527005:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.527010:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527019:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527038:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527046:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527066:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.527372:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.527378:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.527386:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eee00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.527389:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.527397:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.527408:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.527423:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd86a31c/0x74872e3eca9f2af0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.527437:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.527438:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.527440:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.527812:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.527818:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527827:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.527830:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.527834:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527843:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527852:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527859:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.527926:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601711.528180:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.528185:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.528410:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.528414:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.528418:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.528429:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.528437:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.528444:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528468:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601711.528474:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528481:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.528485:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528492:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528504:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528512:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d039186/0x74872e3eca9f2af7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528532:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.528536:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528549:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.528552:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528599:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528610:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.528618:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.528620:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.528622:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.528795:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789601711.528801:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f6e090/0x74872e3eca9f2afe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601711.529071:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.529077:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529090:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.529094:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.529098:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529106:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529113:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529120:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529244:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.529250:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529258:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.529261:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529269:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529281:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529294:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.529295:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.529297:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.529353:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789601711.529359:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038955b34/0x74872e3eca9f2b05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.529519:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.529691:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.529697:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529705:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.529708:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.529713:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529731:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529739:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529746:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529760:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601711.529977:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.529982:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.529990:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.529992:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.529996:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530003:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530011:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530027:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530041:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789601711.530304:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601711.530309:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530317:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212f200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.530321:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601711.530327:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789601711.530328:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530332:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530339:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1789601711.530341:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530342:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.530347:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530348:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088fb8602/0x74872e3eca9f2b0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530356:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530363:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601711.530364:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530371:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530376:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530384:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601711.530498:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212fe00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.530508:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530517:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530528:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530535:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace62c79/0x74872e3eca9f2b13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530548:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.530551:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530573:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212f000 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.530576:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530584:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530594:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530601:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfe62aec/0x74872e3eca9f2b1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601711.530610:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.530615:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.530619:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.530621:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.530623:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.530628:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601711.530628:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.530631:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.530635:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530644:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530652:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530659:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530707:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601711.530975:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.530982:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.530990:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.530993:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.530998:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.531007:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.531024:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.531031:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601711.534089:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601711.534146:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.534158:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601711.534171:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212ee00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601711.534175:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601711.534186:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601711.534266:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.534267:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.534273:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601711.534275:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d35ab763/0x74872e3eca9f2b21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.534281:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212e200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.534284:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.534291:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601711.534296:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601711.534298:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601711.534299:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.534301:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.534308:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af203c09/0x74872e3eca9f2b28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.534319:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.534321:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.534323:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601711.534349:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789601711.535142:0:18553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789601711.535150:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.535163:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=579s v=(0 0) 00010000:00010000:1.0:1789601711.535168:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601711.535174:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.535185:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.535253:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.535263:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601711.535370:0:18553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789601711.535412:0:18553:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789601711.535509:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17072:x1876532918432896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92848us (93193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601711.535518:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601711.535640:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17072:1876532918432896:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789601711.535656:0:17072:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789601711.535696:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17072:1876532918433664:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789601711.535790:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601711.535818:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64540 going to sleep for 11 seconds 00000100:00100000:1.0:1789601711.535855:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433664 00000100:00100000:1.0:1789601711.535861:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433664 00000100:00100000:1.0:1789601711.535900:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601711.535908:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17072:x1876532918433664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789601711.535939:0:19127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1789601711.538659:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17072:x1876532918433664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2745us (2862us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789601711.538669:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601711.538793:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17072:1876532918433664:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789601711.538807:0:17072:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789601711.538939:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601711.538948:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.538967:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212fc00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:2.0:1789601711.538972:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.538983:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.539003:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.539010:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e601f93/0x74872e3eca9f2b2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601711.539031:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.539033:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601711.539035:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601712.134884:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601712.188877:0:19722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1789601712.778531:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789601713.158088:0:19774:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00010000:00010000:3.0:1789601713.158368:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789601713.163528:0:19774:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789601714.055527:0:19824:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789601714.056164:0:19824:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789601714.183352:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601714.343151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.343474:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416384 00000100:00100000:2.0:1789601714.343485:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416384 00000100:00100000:2.0:1789601714.343540:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:2.0:1789601714.343548:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2414:x1876532898416384:12345-192.168.203.48@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789601714.343604:0:17037:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 436a5db0-0172-499e-8bf1-5cb020bea989@192.168.203.48@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:2.0:1789601714.343631:0:17037:0:(genops.c:1384:class_connect()) connect: client 436a5db0-0172-499e-8bf1-5cb020bea989, cookie 0x74872e3eca9f2b36 00000100:00080000:2.0:1789601714.343778:0:17037:0:(import.c:65:import_set_state_nolock()) ffff8df4d878a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601714.343857:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+5:2414:x1876532898416384:12345-192.168.203.48@tcp:250:mount.lustre.0 Request processed in 309us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.343864:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:2.0:1789601714.347720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.348296:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416512 00000100:00100000:0.0:1789601714.348307:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416512 00000100:00100000:0.0:1789601714.348367:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1789601714.348378:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+5:14902:x1876532898416512:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601714.348394:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601714.348413:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e93 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601714.348468:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e93 expref: 6 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601714.348480:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466a00/0x74872e3eca9f2b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e93 expref: 6 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601714.348488:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466a00, rc 0) 00000100:00100000:0.0:1789601714.348549:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+6:14902:x1876532898416512:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 173us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601714.348599:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:3.0:1789601714.352639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.353142:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416640 00000100:00100000:0.0:1789601714.353152:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416640 00000100:00100000:0.0:1789601714.353217:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:0.0:1789601714.353228:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+6:14902:x1876532898416640:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789601714.353355:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+6:14902:x1876532898416640:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 129us (726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601714.353364:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:3.0:1789601714.363969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.364161:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416768 00000100:00100000:2.0:1789601714.364173:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416768 00000100:00100000:2.0:1789601714.364261:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:2.0:1789601714.364271:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+6:14902:x1876532898416768:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601714.364288:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601714.364306:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d400/0x74872e3eca9f2b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48e9a expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.364335:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d400/0x74872e3eca9f2b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e9a expref: 7 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.364345:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d400/0x74872e3eca9f2b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48e9a expref: 7 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.364354:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d400, rc 0) 00000100:00100000:2.0:1789601714.364416:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+7:14902:x1876532898416768:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.364423:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:3.0:1789601714.371325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.371486:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898416896 00000100:00100000:2.0:1789601714.371497:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898416896 00000100:00100000:2.0:1789601714.371612:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:2.0:1789601714.371625:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+7:14902:x1876532898416896:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789601714.371807:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+8:14902:x1876532898416896:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 184us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.371828:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1789601714.383846:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.388814:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417024 00000100:00100000:0.0:1789601714.388831:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417024 00000100:00100000:2.0:1789601714.389203:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:2.0:1789601714.389215:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+8:14902:x1876532898417024:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789601714.389374:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+8:14902:x1876532898417024:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 160us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.389382:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1789601714.394775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.394883:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417152 00000100:00100000:0.0:1789601714.394898:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417152 00000100:00100000:0.0:1789601714.394970:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1789601714.394990:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417152:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601714.397803:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417152:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 2360us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601714.397834:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:3.0:1789601714.429172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.430635:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417280 00000100:00100000:2.0:1789601714.430661:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417280 00000100:00100000:2.0:1789601714.430740:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:2.0:1789601714.430751:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417280:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601714.431105:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417280:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 354us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.431113:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:3.0:1789601714.435969:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.436105:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417408 00000100:00100000:2.0:1789601714.436122:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417408 00000100:00100000:2.0:1789601714.436254:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:2.0:1789601714.436265:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417408:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601714.436444:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+8:14921:x1876532898417408:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 181us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.436452:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:3.0:1789601714.443431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.443737:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417536 00000100:00100000:2.0:1789601714.443751:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417536 00000100:00100000:2.0:1789601714.443824:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:2.0:1789601714.443837:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+8:14902:x1876532898417536:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601714.443880:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601714.443905:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737c600/0x74872e3eca9f2b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ecb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.443942:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737c600/0x74872e3eca9f2b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ecb expref: 9 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.443957:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737c600/0x74872e3eca9f2b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ecb expref: 9 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.443967:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c600, rc 0) 00000100:00100000:2.0:1789601714.444053:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+9:14902:x1876532898417536:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 218us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.444061:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:3.0:1789601714.452447:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.453188:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417664 00000100:00100000:2.0:1789601714.453202:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417664 00000100:00100000:2.0:1789601714.453276:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:2.0:1789601714.453289:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+9:14902:x1876532898417664:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789601714.453322:0:17038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789601714.453355:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789601714.453360:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789601714.453363:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789601714.453366:0:17038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789601714.453368:0:17038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789601714.457438:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+9:14902:x1876532898417664:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 4136us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.457458:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:3.0:1789601714.463881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.464062:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417792 00000100:00100000:2.0:1789601714.464095:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417792 00000100:00100000:2.0:1789601714.464168:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:2.0:1789601714.464190:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+9:14902:x1876532898417792:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601714.464212:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601714.464238:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ed2 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.464279:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 10 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.464293:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 10 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.464305:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ca00, rc 0) 00000100:00100000:2.0:1789601714.464383:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:14902:x1876532898417792:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 204us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.464391:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:3.0:1789601714.466423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.466893:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898417920 00000100:00100000:2.0:1789601714.466906:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898417920 00000100:00100000:2.0:1789601714.467036:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1789601714.467048:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f6c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+10:14902:x1876532898417920:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789601714.467263:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f6c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+10:14902:x1876532898417920:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 216us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.467272:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:3.0:1789601714.470291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.471531:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418048 00000100:00100000:0.0:1789601714.471547:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418048 00000100:00100000:0.0:1789601714.472137:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:0.0:1789601714.472151:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:14902:x1876532898418048:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601714.472449:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:14902:x1876532898418048:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 301us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601714.472457:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:3.0:1789601714.476584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601714.476807:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418176 00000100:00100000:0.0:1789601714.476817:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418176 00000100:00100000:0.0:1789601714.476878:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:0.0:1789601714.476891:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:14926:x1876532898418176:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601714.477050:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:14926:x1876532898418176:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 162us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601714.477058:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:3.0:1789601714.478955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.479263:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418304 00000100:00100000:2.0:1789601714.479273:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418304 00000100:00100000:2.0:1789601714.479389:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:2.0:1789601714.479399:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+10:14926:x1876532898418304:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601714.482173:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+10:14926:x1876532898418304:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 2764us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.482197:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:3.0:1789601714.495592:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601714.496247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.497615:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418432 00000100:00100000:2.0:1789601714.497627:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418432 00000100:00100000:2.0:1789601714.497673:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418688 00000100:00100000:2.0:1789601714.497684:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418688 00000100:00100000:2.0:1789601714.497709:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601714.497717:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2414:x1876532898418432:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789601714.497745:0:17047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cd6d66ee-38de-4023-8d86-925c5cce8186@192.168.203.48@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:2.0:1789601714.497794:0:17047:0:(genops.c:1384:class_connect()) connect: client cd6d66ee-38de-4023-8d86-925c5cce8186, cookie 0x74872e3eca9f2b59 00000004:00100000:2.0:1789601714.497817:0:17047:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789601714.498023:0:17047:0:(import.c:65:import_set_state_nolock()) ffff8df4d878c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601714.498102:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2414:x1876532898418432:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 384us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.498109:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601714.498131:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:2.0:1789601714.498136:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2414:x1876532898418688:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789601714.498151:0:17047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from cd6d66ee-38de-4023-8d86-925c5cce8186@192.168.203.48@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:2.0:1789601714.498190:0:17047:0:(genops.c:1384:class_connect()) connect: client cd6d66ee-38de-4023-8d86-925c5cce8186, cookie 0x74872e3eca9f2b60 00000004:00100000:2.0:1789601714.498205:0:17047:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789601714.499241:0:17047:0:(import.c:65:import_set_state_nolock()) ffff8df4efcd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601714.499292:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2414:x1876532898418688:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 1154us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.499301:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789601714.513054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601714.513111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601714.513144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601714.513245:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418816 00000100:00100000:1.0:1789601714.513256:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418816 00000100:00100000:1.0:1789601714.513363:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418560 00000100:00100000:1.0:1789601714.513367:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418560 00000100:00100000:1.0:1789601714.513384:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898418944 00000100:00100000:1.0:1789601714.513387:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898418944 00000100:00100000:1.0:1789601714.513401:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789601714.513410:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:0:x1876532898418816:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601714.513446:0:17045:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789601714.513534:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:0:x1876532898418816:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 124us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601714.513540:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789601714.513600:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1789601714.513606:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:0:x1876532898418560:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601714.513622:0:17045:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601714.513676:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:0:x1876532898418560:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 71us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601714.513683:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1789601714.513695:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789601714.513701:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898418944:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601714.513712:0:17045:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601714.513735:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898418944:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601714.513741:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00080000:3.0:1789601714.513910:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601714.513914:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601714.520460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601714.520910:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419072 00000100:00100000:1.0:1789601714.520919:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419072 00000100:00100000:1.0:1789601714.520979:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789601714.520990:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419072:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789601714.521077:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419072:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 89us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601714.521084:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789601714.530530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601714.530659:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601714.530718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601714.530764:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419200 00000100:00100000:3.0:1789601714.530781:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419200 00000100:00100000:3.0:1789601714.530838:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419328 00000100:00100000:3.0:1789601714.530842:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419328 00000100:00100000:3.0:1789601714.530873:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789601714.530883:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2414:x1876532898419200:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789601714.530928:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cd6d66ee-38de-4023-8d86-925c5cce8186@192.168.203.48@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:3.0:1789601714.530991:0:18552:0:(genops.c:1384:class_connect()) connect: client cd6d66ee-38de-4023-8d86-925c5cce8186, cookie 0x74872e3eca9f2b67 00002000:00100000:3.0:1789601714.531005:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd6d66ee-38de-4023-8d86-925c5cce8186/ffff8df3c1b72800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789601714.531044:0:18552:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789601714.531476:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1789601714.531484:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2414:x1876532898419328:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789601714.531515:0:19127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cd6d66ee-38de-4023-8d86-925c5cce8186@192.168.203.48@tcp t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:1.0:1789601714.531550:0:19127:0:(genops.c:1384:class_connect()) connect: client cd6d66ee-38de-4023-8d86-925c5cce8186, cookie 0x74872e3eca9f2b6e 00002000:00100000:1.0:1789601714.531605:0:19127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd6d66ee-38de-4023-8d86-925c5cce8186/ffff8df3c3104800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789601714.531621:0:19127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789601714.531754:0:19127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789601714.531799:0:19127:0:(import.c:65:import_set_state_nolock()) ffff8df3c3106800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601714.531891:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2414:x1876532898419328:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 405us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601714.531899:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00002000:00080000:3.0:1789601714.532479:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789601714.533691:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df3c1b74800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601714.533789:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2414:x1876532898419200:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 2901us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601714.533803:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601714.534695:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419456 00000100:00100000:2.0:1789601714.534711:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419456 00000100:00100000:2.0:1789601714.535519:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601714.535530:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419456:12345-192.168.203.48@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789601714.535644:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419456:12345-192.168.203.48@tcp:900:mount.lustre.0 Request processed in 115us (5123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.535651:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1789601714.538100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601714.538271:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419584 00000100:00100000:3.0:1789601714.538283:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419584 00000100:00100000:3.0:1789601714.538338:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789601714.538349:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419584:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789601714.543804:0:17048:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5367us 00000004:00200000:0.0:1789601714.570979:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789601714.571137:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14902:x1876532898419584:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 32784us (33040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601714.571150:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1789601714.828546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601714.828676:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419712 00000100:00100000:2.0:1789601714.828704:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419712 00000100:00100000:2.0:1789601714.828763:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789601714.828773:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:14949:x1876532898419712:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:2.0:1789601714.828794:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601714.828819:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2b75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f03 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.828888:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.828902:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.828915:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601714.828968:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789601714.828972:0:17047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601714.829007:0:17047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.829034:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2b75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f03 expref: 8 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.829069:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f03 expref: 7 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601714.829078:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:2.0:1789601714.829080:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601714.829084:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c800, rc 0) 00000100:00100000:2.0:1789601714.829146:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:14949:x1876532898419712:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 374us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601714.829153:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00010000:00010000:3.0:1789601715.206797:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601715.530056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601715.530081:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918433792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601715.530151:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601715.531677:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433792 00000100:00100000:2.0:1789601715.531688:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433792 00000100:00100000:2.0:1789601715.531786:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601715.531797:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918433792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601715.531822:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601715.531894:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918433792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601715.531901:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601715.532083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918433792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789601715.532152:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601716.039679:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918433920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601716.039794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.039863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601716.039870:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918434048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601716.039893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601716.039970:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918433920 00000100:00100000:1.0:1789601716.039979:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918433920 00000100:00100000:1.0:1789601716.040014:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434048 00000100:00100000:1.0:1789601716.040017:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434048 00000100:00100000:1.0:1789601716.040034:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601716.040042:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918433920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601716.040086:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789601716.040140:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918433920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.040146:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601716.040162:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601716.040178:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918434048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601716.040196:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601716.040238:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918434048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.040244:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601716.040724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918434048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789601716.040737:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918433920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789601716.229815:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601716.550789:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918434176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601716.550858:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601716.551010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918434304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601716.551037:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.551817:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434176 00000100:00100000:2.0:1789601716.551826:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434176 00000100:00100000:2.0:1789601716.551875:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434304 00000100:00100000:2.0:1789601716.551878:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434304 00000100:00100000:2.0:1789601716.551911:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601716.551920:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918434176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601716.551951:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601716.552002:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918434176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.552010:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601716.552029:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601716.552034:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876532918434304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601716.552043:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601716.552065:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876532918434304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.552085:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789601716.552109:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601716.552121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918434432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.552202:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918434944:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.552242:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918435456:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552261:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.552284:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789601716.552289:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918434560:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.552342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918435072:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552362:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601716.552386:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434944 00000100:00100000:2.0:1789601716.552390:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434944 00000100:00100000:2.0:1789601716.552410:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435456 00000100:00100000:2.0:1789601716.552413:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435456 00000100:00100000:2.0:1789601716.552428:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435072 00000100:00100000:2.0:1789601716.552431:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435072 00000100:00100000:2.0:1789601716.552443:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601716.552450:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918434944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552484:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918434944:12345-0@lo:400:kworker.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.552490:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601716.552501:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601716.552507:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918435456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552531:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918435456:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.552535:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601716.552545:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601716.552549:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918435072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552616:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918435072:12345-0@lo:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.552623:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789601716.552640:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601716.552643:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601716.552669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918435072:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.552727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918434944:0@lo:400:kworker.0 00010000:00080000:2.0:1789601716.552747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a7b80 x1876532918435456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601716.552757:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918435456:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.552855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918434816:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.552889:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601716.552917:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918435328:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.552940:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601716.552967:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918434304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601716.552981:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601716.552986:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918434688:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.553006:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601716.553027:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918435200:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.553062:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601716.553611:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434560 00000100:00100000:0.0:1789601716.553617:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434560 00000100:00100000:0.0:1789601716.553648:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434816 00000100:00100000:0.0:1789601716.553657:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434816 00000100:00100000:0.0:1789601716.553677:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601716.553684:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601716.553729:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918434560:12345-0@lo:400:kworker.0 Request processed in 46us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601716.553734:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601716.553748:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601716.553754:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918434816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601716.553781:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918434816:12345-0@lo:400:kworker.0 Request processed in 28us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601716.553786:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601716.553859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918435584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789601716.553898:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601716.553950:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918434816:0@lo:400:kworker.0 00000100:00100000:1.0:1789601716.554478:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435328 00000100:00100000:1.0:1789601716.554485:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435328 00000100:00100000:1.0:1789601716.554512:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434688 00000100:00100000:1.0:1789601716.554516:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434688 00000100:00100000:1.0:1789601716.554526:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435200 00000100:00100000:1.0:1789601716.554528:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435200 00000100:00100000:1.0:1789601716.554543:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601716.554549:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918435328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601716.554635:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918435328:12345-0@lo:400:kworker.0 Request processed in 85us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.554641:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601716.554655:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601716.554660:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918434688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601716.554687:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876532918434688:12345-0@lo:400:kworker.0 Request processed in 27us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.554692:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601716.554703:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601716.554708:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918435200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601716.554735:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918435200:12345-0@lo:400:kworker.0 Request processed in 27us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.554740:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601716.554757:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435584 00000100:00100000:1.0:1789601716.554769:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435584 00000100:00100000:1.0:1789601716.554788:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601716.554794:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918435584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789601716.554829:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789601716.554867:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918435584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.554873:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601716.554911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918435584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601716.554945:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918434176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601716.554965:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918434432 00000100:00100000:1.0:1789601716.554969:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918434432 00000100:00100000:1.0:1789601716.554990:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789601716.554996:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3647:x1876532918434432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601716.555028:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3647:x1876532918434432:12345-0@lo:400:kworker.0 Request processed in 33us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.555034:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789601716.555138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876532918434688:0@lo:400:kworker.0 00010000:00080000:3.0:1789601716.555151:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4f73a6680 x1876532918435200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601716.555176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918435200:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.555188:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918435328:0@lo:400:kworker.0 00000100:00080000:2.0:1789601716.555277:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601716.555281:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601716.555284:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601716.555305:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918434560:0@lo:400:kworker.0 00000100:00100000:2.0:1789601716.555315:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918434432:0@lo:400:kworker.0 00000100:00100000:3.0:1789601716.904483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601716.904721:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419840 00000100:00100000:0.0:1789601716.904731:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419840 00000100:00100000:0.0:1789601716.904809:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1789601716.904819:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15002:x1876532898419840:12345-192.168.203.48@tcp:41:lfs.0 00000100:00080000:2.0:1789601716.904834:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789601716.904860:0:17045:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789601716.904954:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15002:x1876532898419840:12345-192.168.203.48@tcp:41:lfs.0 Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601716.904962:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1789601716.908338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601716.908442:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898419968 00000100:00100000:2.0:1789601716.908455:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898419968 00000100:00100000:2.0:1789601716.908594:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:2.0:1789601716.908604:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898419968:12345-192.168.203.48@tcp:41:lfs.0 00000004:00000024:2.0:1789601716.908641:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789601716.909516:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898419968:12345-192.168.203.48@tcp:41:lfs.0 Request processed in 911us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.909526:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00080000:0.0:1789601716.909647:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789601716.914536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601716.915122:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420096 00000100:00100000:1.0:1789601716.915132:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420096 00000100:00100000:1.0:1789601716.915276:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789601716.915299:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898420096:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:1.0:1789601716.915324:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789601716.915411:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898420096:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 125us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601716.915418:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789601716.918203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601716.918315:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420224 00000100:00100000:2.0:1789601716.918324:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420224 00000100:00080000:0.0:1789601716.920619:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601716.920630:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601716.921587:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1789601716.921601:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898420224:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:2.0:1789601716.921626:0:18556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601716.923505:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15002:x1876532898420224:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 1897us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601716.923517:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000001:00100000:0.0:1789601717.068256:0:19366:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd6d66ee-38de-4023-8d86-925c5cce8186 00000001:00080000:0.0:1789601717.068279:0:19366:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:2.0:1789601717.129002:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789601717.135434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.136973:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420352 00000100:00100000:0.0:1789601717.136985:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420352 00000100:00100000:0.0:1789601717.137125:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:0.0:1789601717.137136:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+10:15035:x1876532898420352:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601717.137153:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601717.137181:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f2b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f0a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.137209:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f2b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f0a expref: 11 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.137219:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466000/0x74872e3eca9f2b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f0a expref: 11 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.137226:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466000, rc 0) 00000100:00100000:0.0:1789601717.137294:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898420352:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 155us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601717.137301:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:3.0:1789601717.150527:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.150892:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420480 00000100:00100000:2.0:1789601717.150905:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420480 00000100:00100000:2.0:1789601717.150972:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:2.0:1789601717.150983:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898420480:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789601717.151781:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898420480:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 796us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.151792:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:3.0:1789601717.160041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.160286:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420608 00000100:00100000:0.0:1789601717.160299:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420608 00000100:00100000:0.0:1789601717.160368:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:0.0:1789601717.160380:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898420608:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601717.160615:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898420608:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 237us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601717.160623:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:3.0:1789601717.174540:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.175187:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420736 00000100:00100000:2.0:1789601717.175201:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420736 00000100:00100000:2.0:1789601717.175294:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:2.0:1789601717.175306:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420736:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601717.175520:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420736:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 216us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.175529:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:3.0:1789601717.196458:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.196616:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420864 00000100:00100000:2.0:1789601717.196631:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420864 00000100:00100000:2.0:1789601717.196768:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:2.0:1789601717.196781:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420864:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601717.197028:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420864:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 249us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.197038:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:3.0:1789601717.201289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.201617:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898420992 00000100:00100000:0.0:1789601717.201631:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898420992 00000100:00100000:0.0:1789601717.201729:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:0.0:1789601717.201745:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420992:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601717.202525:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+11:15041:x1876532898420992:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 776us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.202546:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:3.0:1789601717.205890:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.206101:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421120 00000100:00100000:0.0:1789601717.206114:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421120 00000100:00100000:0.0:1789601717.206196:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:0.0:1789601717.206207:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:15035:x1876532898421120:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601717.206230:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601717.206254:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df3c3466400/0x74872e3eca9f2b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f3b expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.206293:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df3c3466400/0x74872e3eca9f2b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f3b expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.206307:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df3c3466400/0x74872e3eca9f2b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f3b expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601717.206319:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c3466400, rc 0) 00000100:00100000:0.0:1789601717.206394:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+12:15035:x1876532898421120:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 190us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601717.206402:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:3.0:1789601717.210328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.210457:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421248 00000100:00100000:1.0:1789601717.210471:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421248 00000100:00100000:1.0:1789601717.210542:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00100000:1.0:1789601717.210593:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+12:15035:x1876532898421248:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789601717.210638:0:17039:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789601717.210685:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789601717.210690:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789601717.210693:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789601717.210697:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789601717.210699:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789601717.213245:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+12:15035:x1876532898421248:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 2677us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.213264:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00100000:3.0:1789601717.217394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.217541:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421376 00000100:00100000:2.0:1789601717.217584:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421376 00000100:00100000:2.0:1789601717.217844:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:2.0:1789601717.217858:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+12:15035:x1876532898421376:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601717.217898:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601717.217922:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f42 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.217959:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 13 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.217971:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 13 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.217982:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c400, rc 0) 00000100:00100000:2.0:1789601717.218292:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+13:15035:x1876532898421376:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 435us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.218301:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:3.0:1789601717.222196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.222464:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421504 00000100:00100000:1.0:1789601717.222477:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421504 00000100:00100000:1.0:1789601717.222550:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:1.0:1789601717.222607:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:15035:x1876532898421504:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789601717.222857:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:15035:x1876532898421504:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 253us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.222867:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:3.0:1789601717.225767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.226179:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421632 00000100:00100000:2.0:1789601717.226193:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421632 00000100:00100000:2.0:1789601717.226271:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:2.0:1789601717.226284:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+13:15035:x1876532898421632:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789601717.226491:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+13:15035:x1876532898421632:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 209us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.226500:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:3.0:1789601717.245421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.246726:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421760 00000100:00100000:0.0:1789601717.246741:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421760 00000100:00100000:0.0:1789601717.246820:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:0.0:1789601717.246833:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+13:15046:x1876532898421760:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601717.247033:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+13:15046:x1876532898421760:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 202us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601717.247041:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00010000:00010000:2.0:1789601717.255445:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601717.258008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.258309:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898421888 00000100:00100000:1.0:1789601717.258323:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898421888 00000100:00100000:1.0:1789601717.258397:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:1.0:1789601717.258411:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:15046:x1876532898421888:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601717.258906:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:15046:x1876532898421888:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 496us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.258917:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:3.0:1789601717.271293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.272052:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422016 00000100:00100000:1.0:1789601717.272066:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422016 00000100:00100000:1.0:1789601717.272137:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789601717.272148:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2414:x1876532898422016:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789601717.272195:0:17046:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e405907e-9072-4b15-9fd7-2bb5f7d7c0b7@192.168.203.48@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:1.0:1789601717.272247:0:17046:0:(genops.c:1384:class_connect()) connect: client e405907e-9072-4b15-9fd7-2bb5f7d7c0b7, cookie 0x74872e3eca9f2b98 00000004:00100000:1.0:1789601717.272280:0:17046:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789601717.272409:0:17046:0:(import.c:65:import_set_state_nolock()) ffff8df3c3104000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601717.272518:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2414:x1876532898422016:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 371us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.272527:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789601717.273771:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601717.274123:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422272 00000100:00100000:0.0:1789601717.274154:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422272 00000100:00100000:0.0:1789601717.274219:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789601717.274229:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2414:x1876532898422272:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789601717.274264:0:17045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e405907e-9072-4b15-9fd7-2bb5f7d7c0b7@192.168.203.48@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:0.0:1789601717.274310:0:17045:0:(genops.c:1384:class_connect()) connect: client e405907e-9072-4b15-9fd7-2bb5f7d7c0b7, cookie 0x74872e3eca9f2b9f 00000004:00100000:0.0:1789601717.274338:0:17045:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789601717.274446:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8df3c1a1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601717.274509:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2414:x1876532898422272:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 281us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601717.274517:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1789601717.286789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601717.286825:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601717.286917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.292228:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422144 00000100:00100000:1.0:1789601717.292249:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422144 00000100:00100000:1.0:1789601717.292341:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422400 00000100:00100000:1.0:1789601717.292345:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422400 00000100:00100000:1.0:1789601717.292365:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422528 00000100:00100000:1.0:1789601717.292367:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422528 00000100:00100000:1.0:1789601717.292394:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789601717.292405:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+7:0:x1876532898422144:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601717.292451:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601717.292548:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+7:0:x1876532898422144:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 144us (5775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.292574:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789601717.292613:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1789601717.292620:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:0:x1876532898422400:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601717.292633:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1789601717.292773:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789601717.292779:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601717.293222:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:0:x1876532898422400:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 600us (6393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.293230:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1789601717.293247:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1789601717.293254:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898422528:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789601717.293268:0:17047:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601717.293291:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898422528:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 39us (6375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.293297:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:3.0:1789601717.295593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601717.295702:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422656 00000100:00100000:1.0:1789601717.295713:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422656 00000100:00100000:1.0:1789601717.295770:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789601717.295782:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898422656:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789601717.296073:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898422656:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 293us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601717.296083:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601717.307952:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.308630:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423040 00000100:00100000:2.0:1789601717.308643:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423040 00000100:00100000:2.0:1789601717.308773:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789601717.308788:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898423040:12345-192.168.203.48@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789601717.308915:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898423040:12345-192.168.203.48@tcp:900:mount.lustre.0 Request processed in 130us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.308925:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789601717.309124:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601717.309277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601717.309305:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422784 00000100:00100000:3.0:1789601717.309310:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422784 00000100:00100000:3.0:1789601717.309330:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898422912 00000100:00100000:3.0:1789601717.309333:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898422912 00000100:00100000:3.0:1789601717.309352:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601717.309357:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2414:x1876532898422784:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789601717.309392:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e405907e-9072-4b15-9fd7-2bb5f7d7c0b7@192.168.203.48@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:3.0:1789601717.309433:0:18552:0:(genops.c:1384:class_connect()) connect: client e405907e-9072-4b15-9fd7-2bb5f7d7c0b7, cookie 0x74872e3eca9f2ba6 00002000:00100000:3.0:1789601717.309448:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e405907e-9072-4b15-9fd7-2bb5f7d7c0b7/ffff8df3c1b77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789601717.309463:0:18552:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789601717.309655:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789601717.309692:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df3c1b70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601717.309741:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2414:x1876532898422784:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 382us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601717.309749:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789601717.309767:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789601717.309784:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2414:x1876532898422912:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789601717.309801:0:18552:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e405907e-9072-4b15-9fd7-2bb5f7d7c0b7@192.168.203.48@tcp t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:3.0:1789601717.309819:0:18552:0:(genops.c:1384:class_connect()) connect: client e405907e-9072-4b15-9fd7-2bb5f7d7c0b7, cookie 0x74872e3eca9f2bad 00002000:00100000:3.0:1789601717.309824:0:18552:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e405907e-9072-4b15-9fd7-2bb5f7d7c0b7/ffff8df3c1b77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789601717.309831:0:18552:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789601717.309888:0:18552:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789601717.309905:0:18552:0:(import.c:65:import_set_state_nolock()) ffff8df3c1b71000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601717.309929:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2414:x1876532898422912:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 145us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601717.309937:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789601717.310714:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601717.310766:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423168 00000100:00100000:3.0:1789601717.310774:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423168 00000100:00100000:3.0:1789601717.310814:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789601717.310824:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898423168:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789601717.310924:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789601717.311516:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15035:x1876532898423168:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 691us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601717.311526:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789601717.472506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601717.472696:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423296 00000100:00100000:2.0:1789601717.472709:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423296 00000100:00100000:2.0:1789601717.472784:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1789601717.472798:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15069:x1876532898423296:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:2.0:1789601717.472824:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601717.472851:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f73 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.472936:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.472953:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.472967:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601717.473034:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789601717.473039:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601717.473062:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.473094:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 8 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.473116:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 7 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601717.473145:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:2.0:1789601717.473149:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601717.473164:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737de00, rc 0) 00000100:00100000:2.0:1789601717.473252:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+7:15069:x1876532898423296:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 458us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601717.473260:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00010000:00010000:3.0:1789601718.277918:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601719.302335:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789601719.625951:0:18548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e405907e-9072-4b15-9fd7-2bb5f7d7c0b7 00000001:00100000:3.0:1789601719.625966:0:18548:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd6d66ee-38de-4023-8d86-925c5cce8186 00000001:00100000:2.0:1789601719.627455:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e405907e-9072-4b15-9fd7-2bb5f7d7c0b7 00000001:00100000:2.0:1789601719.627467:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cd6d66ee-38de-4023-8d86-925c5cce8186 00000001:00100000:0.0:1789601719.627783:0:17025:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e405907e-9072-4b15-9fd7-2bb5f7d7c0b7 00000001:00100000:0.0:1789601719.627792:0:17025:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd6d66ee-38de-4023-8d86-925c5cce8186 00010000:00010000:2.0:1789601720.327310:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601720.449582:0:19922:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789601720.649924:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601720.649948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601720.650052:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601720.650105:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435712 00000100:00100000:2.0:1789601720.650113:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435712 00000100:00100000:2.0:1789601720.650179:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789601720.650188:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918435712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601720.650216:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601720.650271:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918435712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601720.650278:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789601720.650301:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601720.650338:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601721.157844:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918435840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789601721.157967:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.158243:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435840 00000100:00100000:1.0:1789601721.158251:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435840 00000100:00100000:1.0:1789601721.158297:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789601721.158307:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918435840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601721.158350:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789601721.158405:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918435840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.158418:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789601721.158439:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601721.158448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918435968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601721.158475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.158514:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918435968 00000100:00100000:1.0:1789601721.158518:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918435968 00000100:00100000:1.0:1789601721.158535:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789601721.158541:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918435968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601721.158576:0:17051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601721.158609:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918435968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.158615:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601721.159211:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918435840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601721.159749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918435968:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789601721.350056:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601721.672955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918436096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673117:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918436608:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673153:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673174:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918437120:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673237:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789601721.673243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918436480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673276:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673295:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918436992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673385:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436608 00000100:00100000:1.0:1789601721.673392:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436608 00000100:00100000:1.0:1789601721.673443:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601721.673451:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918436608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673496:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918436608:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.673502:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601721.673525:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437120 00000100:00100000:1.0:1789601721.673529:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437120 00000100:00100000:1.0:1789601721.673546:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436480 00000100:00100000:1.0:1789601721.673549:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436480 00000100:00100000:1.0:1789601721.673585:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436992 00000100:00100000:1.0:1789601721.673588:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436992 00000100:00100000:1.0:1789601721.673602:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601721.673609:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918437120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673642:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876532918437120:12345-0@lo:400:kworker.0 Request processed in 34us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.673648:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601721.673664:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601721.673671:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918436480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673701:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918436480:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.673708:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601721.673723:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601721.673729:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918436992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673760:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918436992:12345-0@lo:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.673775:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601721.673805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601721.673846:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601721.673886:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918436480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918436992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918436608:0@lo:400:kworker.0 00010000:00080000:1.0:1789601721.673932:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3434000 x1876532918437120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601721.673943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876532918437120:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.673966:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601721.673972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918437504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601721.673995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.679777:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918436224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.679848:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.679893:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918436736:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.679915:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.680050:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918437248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.680077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.680100:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c4066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918437760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601721.680132:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.680157:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789601721.680165:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918436352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.680184:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.682781:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918436864:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.682839:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.682859:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918437376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.682878:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601721.682910:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436096 00000100:00100000:2.0:1789601721.682918:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436096 00000100:00100000:2.0:1789601721.682978:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601721.682988:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683041:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918436096:12345-0@lo:400:kworker.0 Request processed in 55us (9968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683049:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601721.683082:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437248 00000100:00100000:2.0:1789601721.683086:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437248 00000100:00100000:2.0:1789601721.683136:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436864 00000100:00100000:2.0:1789601721.683139:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436864 00000100:00100000:2.0:1789601721.683162:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437376 00000100:00100000:2.0:1789601721.683165:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437376 00000100:00100000:2.0:1789601721.683198:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601721.683216:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918437248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683255:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918437248:12345-0@lo:400:kworker.0 Request processed in 50us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683262:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601721.683276:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601721.683282:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918436864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683305:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876532918436864:12345-0@lo:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683310:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601721.683321:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601721.683327:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918437376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683348:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876532918437376:12345-0@lo:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683354:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789601721.683418:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601721.683423:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789601721.683425:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601721.683447:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437632 00000100:00100000:2.0:1789601721.683451:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437632 00000100:00100000:2.0:1789601721.683475:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437504 00000100:00100000:2.0:1789601721.683478:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437504 00000100:00100000:2.0:1789601721.683489:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918437760 00000100:00100000:2.0:1789601721.683492:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918437760 00000100:00100000:2.0:1789601721.683503:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601721.683516:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918437632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601721.683537:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601721.683588:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918437632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (9741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683593:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601721.683606:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601721.683612:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918437504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789601721.683620:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789601721.683644:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918437504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (9648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683650:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601721.683661:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601721.683667:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918437760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601721.683677:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601721.683705:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918437760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601721.683711:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601721.683768:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876532918436864:0@lo:400:kworker.0 00010000:00080000:2.0:1789601721.683780:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c3437b80 x1876532918437376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601721.683790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876532918437376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683800:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918437248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.683819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c4066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918437760:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789601721.683862:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601721.684825:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918437504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789601721.684840:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789601721.684859:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601721.684871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918436096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.687355:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436224 00000100:00100000:1.0:1789601721.687367:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436224 00000100:00100000:1.0:1789601721.687426:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436736 00000100:00100000:1.0:1789601721.687430:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436736 00000100:00100000:1.0:1789601721.687447:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918436352 00000100:00100000:1.0:1789601721.687449:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918436352 00000100:00100000:1.0:1789601721.687469:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601721.687480:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918436224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.687594:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918436224:12345-0@lo:400:kworker.0 Request processed in 116us (7745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.687602:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601721.687623:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601721.687638:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918436736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.687676:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918436736:12345-0@lo:400:kworker.0 Request processed in 39us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.687682:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601721.687695:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601721.687702:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918436352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601721.687735:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918436352:12345-0@lo:400:kworker.0 Request processed in 32us (7549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601721.687741:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789601721.687981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918436352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.687995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918436224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601721.688006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918436736:0@lo:400:kworker.0 00010000:00010000:3.0:1789601722.380685:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601722.662540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601722.662599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601722.662614:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423424 00000100:00100000:1.0:1789601722.662625:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423424 00000100:00100000:3.0:1789601722.662627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601722.662662:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601722.662672:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:3.0:1789601722.662680:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601722.662682:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:2418:x1876532898423424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.662701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601722.662783:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423680 00000100:00100000:0.0:1789601722.662788:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423680 00000100:00100000:0.0:1789601722.662822:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424192 00000100:00100000:0.0:1789601722.662826:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424192 00000100:00100000:0.0:1789601722.662838:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423552 00000100:00100000:0.0:1789601722.662841:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423552 00000100:00100000:1.0:1789601722.662890:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:2418:x1876532898423424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 209us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601722.662898:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:0.0:1789601722.663020:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789601722.663030:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2418:x1876532898423680:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:1.0:1789601722.663779:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601722.663785:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789601722.670286:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423936 00000100:00100000:2.0:1789601722.670301:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423936 00000100:00100000:2.0:1789601722.670366:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424448 00000100:00100000:2.0:1789601722.670370:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424448 00000100:00100000:2.0:1789601722.670398:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789601722.670407:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2418:x1876532898423936:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.670704:0:17047:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601722.670715:0:17047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789601722.670769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601722.670787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601722.670803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601722.673499:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898423808 00000100:00100000:3.0:1789601722.673511:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898423808 00000100:00100000:3.0:1789601722.673550:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424320 00000100:00100000:3.0:1789601722.673553:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424320 00000100:00100000:3.0:1789601722.673592:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601722.673602:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2418:x1876532898424448:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.673675:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2418:x1876532898424448:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 75us (10993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.673682:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789601722.673701:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789601722.673707:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2417:x1876532898423808:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.673738:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2417:x1876532898423808:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 32us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.673745:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789601722.673757:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1789601722.673762:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2417:x1876532898424320:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.673783:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2417:x1876532898424320:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 20us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.673789:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1789601722.673806:0:17045:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601722.673813:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424064 00000100:00100000:3.0:1789601722.673818:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424064 00000100:00100000:3.0:1789601722.673876:0:17045:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601722.673883:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789601722.673889:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2418:x1876532898424192:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.673916:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2418:x1876532898424192:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (11254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.673922:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789601722.673934:0:17045:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601722.673939:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1789601722.673945:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2417:x1876532898423552:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.674048:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2417:x1876532898423552:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 102us (11345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.674054:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1789601722.674066:0:17045:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601722.674072:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1789601722.674086:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2417:x1876532898424064:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601722.674112:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2417:x1876532898424064:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.674129:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00080000:3.0:1789601722.674156:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601722.674161:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601722.674163:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601722.678031:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2418:x1876532898423680:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 14994us (15421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601722.678046:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1789601722.686924:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2418:x1876532898423936:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 16508us (24284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601722.686939:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000001:00100000:1.0:1789601722.702097:0:19366:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e405907e-9072-4b15-9fd7-2bb5f7d7c0b7 00000040:00080000:2.0:1789601723.017730:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789601723.398747:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601724.422540:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601724.482211:0:20071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef294b950 20000000:00000080:3.0:1789601724.482238:0:20071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df4efc7e800 uarg=0000000000000000 20000000:01000000:3.0:1789601724.482322:0:20071:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789601724.482330:0:20071:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789601724.482336:0:20071:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789601724.483548:0:20072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789601724.484029:0:20071:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789601724.492425:0:20071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789601724.492470:0:20071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492848:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492861:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492871:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f289d expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492879:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492890:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492898:0:20071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 12 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.492905:0:20071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.493003:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 12 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.493024:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 12 pid: 17037 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.493044:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918437888:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601724.493190:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.493212:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 12 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.493222:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438016:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601724.493259:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.493269:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.493280:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438144:0@lo:104: 00000100:00100000:0.0:1789601724.493328:0:20071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601724.493393:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438144 00000100:00100000:0.0:1789601724.493403:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438144 00000100:00100000:0.0:1789601724.493469:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789601724.493481:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:20071:x1876532918438144:12345-0@lo:104: 00010000:00010000:0.0:1789601724.493498:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.493596:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601724.493603:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:20071:x1876532918438144:12345-0@lo:104: Request processed in 125us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601724.493611:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789601724.496399:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.496422:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601724.496440:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438272:0@lo:104: 00000100:00100000:3.0:1789601724.496510:0:20071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601724.496587:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.496597:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601724.496626:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438400:0@lo:104: 00000100:00100000:1.0:1789601724.496754:0:17028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438272 00000100:00100000:1.0:1789601724.496765:0:17028:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438272 00000100:00100000:1.0:1789601724.496820:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601724.496829:0:17028:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0068b5de-bd03-471c-817a-758c66ef4c46+4:20071:x1876532918438272:12345-0@lo:104: 00010000:00010000:1.0:1789601724.496845:0:17028:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.496916:0:17028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601724.496930:0:17028:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0068b5de-bd03-471c-817a-758c66ef4c46+4:20071:x1876532918438272:12345-0@lo:104: Request processed in 102us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601724.496950:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601724.497058:0:20071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789601724.497098:0:20071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497121:0:20071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601724.497130:0:20071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438528:0@lo:104: 00000100:00100000:3.0:1789601724.497155:0:20071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601724.497167:0:20071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d0aea000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601724.497193:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438144:0@lo:104: 00000100:00100000:3.0:1789601724.497202:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438272:0@lo:104: 00010000:00010000:3.0:1789601724.497235:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601724.497242:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497252:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382000 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601724.497257:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497267:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601724.497276:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601724.497282:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789601724.497331:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497339:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601724.497362:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497370:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f7382000/0x74872e3eca9f2a02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2a09 expref: -99 pid: 19365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497386:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601724.497389:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497396:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c3467c00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:3.0:1789601724.497399:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497407:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601724.497414:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601724.497420:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789601724.497432:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497438:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601724.497453:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497470:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df3c3467c00/0x74872e3eca9f289d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f28a4 expref: -99 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601724.497482:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601724.497484:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601724.497485:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601724.497496:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601724.497509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918438784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601724.497541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601724.497607:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601724.497616:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918438656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601724.497640:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601724.497750:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438784 00000100:00100000:1.0:1789601724.497756:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438784 00010000:00010000:1.0:1789601724.497782:0:18578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 24 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601724.497806:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438656 00000100:00100000:1.0:1789601724.497808:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438656 00010000:00010000:1.0:1789601724.497819:0:18578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 25 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601724.497836:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601724.497843:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+25:3648:x1876532918438784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601724.497855:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601724.497861:0:18578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 25 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.497871:0:18578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 25 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.497888:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1678600/0x74872e3eca9f28a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f289d expref: 25 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.497903:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601724.497948:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918438784:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601724.497956:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601724.497971:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601724.497986:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+23:3645:x1876532918438656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601724.497994:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601724.497999:0:18578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.498008:0:18578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.498018:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3466e00/0x74872e3eca9f2a09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f2a02 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.498027:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601724.499156:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601724.499171:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438400 00000100:00100000:0.0:1789601724.499181:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438400 00000100:00100000:0.0:1789601724.499216:0:17029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438528 00000100:00100000:0.0:1789601724.499233:0:17029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438528 00000100:00100000:0.0:1789601724.499255:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601724.499265:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:20071:x1876532918438400:12345-0@lo:104: 00010000:00010000:0.0:1789601724.499286:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499384:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601724.499390:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+4:20071:x1876532918438400:12345-0@lo:104: Request processed in 128us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601724.499396:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789601724.499413:0:17800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601724.499419:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499427:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73ef800 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601724.499432:0:17800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499441:0:17800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601724.499450:0:17800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601724.499457:0:17800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601724.499527:0:17800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499534:0:17800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601724.499548:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499584:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73ef800/0x74872e3eca9f285e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2865 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499608:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601724.499610:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601724.499611:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601724.499627:0:17029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601724.499634:0:17029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:20071:x1876532918438528:12345-0@lo:104: 00010000:00010000:0.0:1789601724.499643:0:17029:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499699:0:17029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601724.499704:0:17029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0068b5de-bd03-471c-817a-758c66ef4c46+3:20071:x1876532918438528:12345-0@lo:104: Request processed in 71us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601724.499710:0:17029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789601724.499724:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601724.499729:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499737:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f73eea00 already unused, calling callback (ffffffffc1529c20) 10000000:00010000:0.0:1789601724.499740:0:17033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499747:0:17033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601724.499754:0:17033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601724.499767:0:17033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601724.499786:0:17033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499793:0:17033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601724.499802:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499808:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8df4f73eea00/0x74872e3eca9f2850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x74872e3eca9f2857 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.499823:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601724.499825:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601724.499826:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601724.500914:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601724.500948:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918438912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601724.501018:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601724.501078:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918438912 00000100:00100000:2.0:1789601724.501086:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918438912 00010000:00010000:2.0:1789601724.501131:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601724.501156:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601724.501165:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+23:3647:x1876532918438912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601724.501179:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601724.501185:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601724.501197:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 23 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601724.501233:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601724.501280:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+23:3647:x1876532918438912:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601724.501288:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601724.502363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0068b5de-bd03-471c-817a-758c66ef4c46:3647:1876532918438912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601724.502628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601724.502645:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918439040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601724.502894:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601724.503042:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439040 00000100:00100000:0.0:1789601724.503050:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439040 00010000:00010000:0.0:1789601724.503085:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.503131:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601724.503140:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+23:3646:x1876532918439040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601724.503153:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601724.503159:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.503170:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 23 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.503210:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601724.503246:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0068b5de-bd03-471c-817a-758c66ef4c46+23:3646:x1876532918439040:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601724.503253:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601724.503364:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0068b5de-bd03-471c-817a-758c66ef4c46+22:3645:x1876532918438656:12345-0@lo:103:ldlm_bl.0 Request processed in 5376us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601724.503372:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601724.503418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918438784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601724.503852:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918438656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601724.503999:0:20071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4c1679000/0x74872e3eca9f2865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f285e expref: 21 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.504014:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c36a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438400:0@lo:104: 00010000:00010000:0.0:1789601724.504025:0:20071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df3c3467400/0x74872e3eca9f2857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x74872e3eca9f2850 expref: 20 pid: 17038 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.504034:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4d09c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438528:0@lo:104: 00000100:00100000:1.0:1789601724.504350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601724.504381:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601724.504403:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424576 00000100:00100000:1.0:1789601724.504410:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424576 00010000:00010000:1.0:1789601724.504438:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 13 pid: 17037 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601724.504459:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424704 00000100:00100000:1.0:1789601724.504462:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424704 00010000:00010000:1.0:1789601724.504484:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 14 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601724.504499:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789601724.504521:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:436a5db0-0172-499e-8bf1-5cb020bea989+14:2415:x1876532898424576:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601724.504536:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601724.504542:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 14 pid: 17037 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504575:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 14 pid: 17037 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504600:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601724.504673:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:436a5db0-0172-499e-8bf1-5cb020bea989+14:2415:x1876532898424576:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 153us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601724.504681:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789601724.504735:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789601724.504741:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:436a5db0-0172-499e-8bf1-5cb020bea989+13:2415:x1876532898424704:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601724.504749:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601724.504753:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 13 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504763:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 13 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504776:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504786:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504804:0:17031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504819:0:17031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504826:0:17031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504832:0:17031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504839:0:17031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b7400 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601724.504843:0:17031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504852:0:17031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504862:0:17031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601724.504873:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601724.504893:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:436a5db0-0172-499e-8bf1-5cb020bea989+13:2415:x1876532898424704:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 151us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601724.504900:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789601724.505313:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0068b5de-bd03-471c-817a-758c66ef4c46:3646:1876532918439040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601724.506420:0:20071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737c400/0x74872e3eca9f2b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f42 expref: 12 pid: 17037 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.506442:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918437888:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601724.506455:0:20071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ed2 expref: 11 pid: 17039 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601724.506464:0:20071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20071:1876532918438016:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601724.506505:0:20071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.506517:0:20071:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.506523:0:20071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601724.506549:0:20071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df4fb6b7400/0x74872e3eca9f2bc2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.445894:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789601725.638642:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601725.638652:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4eaba5800 from 13 10000000:01000000:0.0:1789601725.638660:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601725.638721:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.638736:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.638750:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601725.638784:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.638872:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601725.638948:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601725.640178:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439168 00000100:00100000:2.0:1789601725.640192:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439168 00000100:00100000:2.0:1789601725.640284:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789601725.640297:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+20:17042:x1876532918439168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601725.640317:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601725.640338:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f2bd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2bc9 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.640374:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f2bd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2bc9 expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.640388:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737d800/0x74872e3eca9f2bd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2bc9 expref: 21 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.640399:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d800, rc 0) 00000100:00100000:2.0:1789601725.640481:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601725.640488:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789601725.640603:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601725.640624:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bd0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.640635:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2bd0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601725.640729:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.640766:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601725.640796:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601725.640810:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439296 00000100:00100000:2.0:1789601725.640814:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439296 00000100:00100000:2.0:1789601725.640840:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789601725.640847:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.640979:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601725.640986:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789601725.641017:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.641066:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.641119:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601725.641133:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601725.641145:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439424 00000100:00100000:2.0:1789601725.641148:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439424 00000100:00100000:2.0:1789601725.641169:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789601725.641175:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.641254:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601725.641267:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789601725.641312:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601725.642449:0:20104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789601725.643174:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789601725.643206:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601725.643220:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bd0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.643233:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7400/0x74872e3eca9f2bc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bd0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601725.643246:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601725.643250:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4c363f000 from 13 10000000:01000000:3.0:1789601725.643253:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601725.643296:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.643305:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.643325:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601725.643353:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.643440:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601725.643489:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789601725.644200:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439552 00000100:00100000:2.0:1789601725.644212:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439552 00000100:00100000:2.0:1789601725.644313:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601725.644325:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+21:17042:x1876532918439552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601725.644342:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601725.644358:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2bde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2bd7 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.644389:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2bd7 expref: 22 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.644401:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f737ca00/0x74872e3eca9f2bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2bd7 expref: 22 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.644411:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737ca00, rc 0) 00000100:00100000:2.0:1789601725.644490:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601725.644497:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789601725.644654:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601725.644671:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bde expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.644683:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2bde expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601725.644761:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.644796:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601725.656287:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f894d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.656987:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439680 00000100:00100000:0.0:1789601725.657000:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439680 00000100:00100000:0.0:1789601725.657165:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789601725.657177:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.657394:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (12597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.657506:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789601725.657644:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.657711:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601725.657766:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601725.657807:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12def00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.658399:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439808 00000100:00100000:0.0:1789601725.658417:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439808 00000100:00100000:0.0:1789601725.658472:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789601725.658481:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.658990:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 509us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.658999:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789601725.659039:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601725.660317:0:20107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789601725.660713:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789601725.660748:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601725.660763:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bde expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.660777:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4f7383c00/0x74872e3eca9f2bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bde expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601725.660790:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601725.660792:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df4e01b3800 from 13 10000000:01000000:0.0:1789601725.660796:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601725.660843:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.660852:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.660863:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601725.660892:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.660968:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601725.661341:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.661368:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918439936 00000100:00100000:0.0:1789601725.661386:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918439936 00000100:00100000:0.0:1789601725.662633:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789601725.662651:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+22:17042:x1876532918439936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601725.662671:0:17037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601725.662692:0:17037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4fb6b6000/0x74872e3eca9f2bec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2be5 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.662725:0:17037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4fb6b6000/0x74872e3eca9f2bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2be5 expref: 23 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.662738:0:17037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4fb6b6000/0x74872e3eca9f2bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2be5 expref: 23 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.662747:0:17037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b6000, rc 0) 00000100:00100000:0.0:1789601725.662827:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918439936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.662835:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789601725.662897:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918439936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601725.662919:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bec expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.662929:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2bec expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601725.663023:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.663065:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601725.663113:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c54f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.663128:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440064 00000100:00100000:0.0:1789601725.663143:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440064 00000100:00100000:0.0:1789601725.663290:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601725.663297:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918440064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.663602:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918440064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.663611:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601725.663649:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.663688:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.663739:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601725.663763:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f5e07f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.663776:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440192 00000100:00100000:0.0:1789601725.663780:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440192 00000100:00100000:0.0:1789601725.663806:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601725.663813:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918440192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.663904:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918440192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.663912:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601725.663956:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789601725.670672:0:20108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789601725.670783:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789601725.670819:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601725.670833:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bec expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.670848:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7800/0x74872e3eca9f2be5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bec expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601725.670873:0:17042:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601725.670876:0:17042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df3c41ab800 from 13 10000000:01000000:0.0:1789601725.670879:0:17042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601725.670926:0:17042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.670935:0:17042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601725.670948:0:17042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601725.670980:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.671321:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601725.671379:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d0aea000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601725.674600:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440320 00000100:00100000:3.0:1789601725.674622:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440320 00000100:00100000:3.0:1789601725.674712:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601725.674725:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+23:17042:x1876532918440320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601725.674750:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601725.674775:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382000/0x74872e3eca9f2bfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74872e3eca9f2bf3 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.674811:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382000/0x74872e3eca9f2bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x74872e3eca9f2bf3 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.674837:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382000/0x74872e3eca9f2bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x74872e3eca9f2bf3 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.674848:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382000, rc 0) 00000100:00100000:3.0:1789601725.674951:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918440320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (3630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601725.674958:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601725.675036:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601725.675058:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bfa expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.675069:0:17042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x74872e3eca9f2bfa expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601725.675192:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.675232:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601725.675265:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601725.675590:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440448 00000100:00100000:0.0:1789601725.675597:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440448 00000100:00100000:0.0:1789601725.675647:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789601725.675657:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918440448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601725.676360:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d1019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918440448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 702us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601725.676371:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789601725.677321:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.677393:0:17042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.677475:0:17042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601725.677504:0:17042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601725.677526:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440576 00000100:00100000:3.0:1789601725.677534:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440576 00000100:00100000:3.0:1789601725.677590:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601725.677599:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918440576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601725.677714:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:17042:x1876532918440576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601725.677722:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601725.677769:0:17042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0068b5de-bd03-471c-817a-758c66ef4c46:17042:1876532918440576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789601725.697297:0:20110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789601725.698144:0:17042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789601725.698177:0:17042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601725.698193:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bfa expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601725.698208:0:17042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8df4fb6b7a00/0x74872e3eca9f2bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x74872e3eca9f2bfa expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601725.765861:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601725.770110:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601725.770630:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601725.770842:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440704 00000100:00100000:3.0:1789601725.770855:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440704 00000100:00100000:3.0:1789601725.770971:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601725.770984:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918440704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601725.771027:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789601725.771108:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918440704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601725.771117:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789601725.771377:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601725.772926:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601725.987604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601725.995665:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424832 00000100:00100000:3.0:1789601725.995688:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424832 00000100:00100000:3.0:1789601725.995771:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:3.0:1789601725.995784:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+11:14916:x1876532898424832:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601725.995806:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601725.995831:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f2c01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f7a expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.995869:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f2c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f7a expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.995882:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7383200/0x74872e3eca9f2c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f7a expref: 12 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601725.995918:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383200, rc 0) 00000100:00100000:3.0:1789601725.996002:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898424832:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 220us (8413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601725.996010:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:0.0:1789601726.018480:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601726.018591:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898424960 00000100:00100000:3.0:1789601726.018603:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898424960 00000100:00100000:3.0:1789601726.018726:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:3.0:1789601726.018737:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898424960:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601726.018928:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898424960:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601726.018936:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:3.0:1789601726.027508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601726.027805:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425088 00000100:00100000:0.0:1789601726.027820:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425088 00000100:00100000:0.0:1789601726.027884:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:0.0:1789601726.027908:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898425088:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601726.028112:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898425088:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 206us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.028121:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:2.0:1789601726.046406:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601726.048490:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425216 00000100:00100000:3.0:1789601726.048510:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425216 00000100:00100000:3.0:1789601726.048808:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:3.0:1789601726.048821:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+12:14916:x1876532898425216:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601726.048845:0:17038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601726.048870:0:17038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f2c08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f81 expref: -99 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601726.048908:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f2c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f81 expref: 13 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601726.048921:0:17038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df4f7382c00/0x74872e3eca9f2c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f81 expref: 13 pid: 17038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601726.048945:0:17038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382c00, rc 0) 00000100:00100000:3.0:1789601726.049032:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+13:14916:x1876532898425216:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 214us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601726.049040:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:0.0:1789601726.054902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601726.054992:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425344 00000100:00100000:3.0:1789601726.055006:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425344 00000100:00100000:3.0:1789601726.055074:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:3.0:1789601726.055087:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:14916:x1876532898425344:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601726.055411:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:14916:x1876532898425344:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 326us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601726.055420:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:3.0:1789601726.064706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601726.065317:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425472 00000100:00100000:2.0:1789601726.065331:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425472 00000100:00100000:2.0:1789601726.065397:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:2.0:1789601726.065410:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+13:14916:x1876532898425472:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601726.065647:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:436a5db0-0172-499e-8bf1-5cb020bea989+13:14916:x1876532898425472:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 238us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601726.065656:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:1.0:1789601726.277781:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918440960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601726.277928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601726.277983:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601726.277991:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918440832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601726.278018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601726.278060:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440960 00000100:00100000:1.0:1789601726.278066:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440960 00000100:00100000:1.0:1789601726.278179:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918440832 00000100:00100000:1.0:1789601726.278184:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918440832 00000100:00100000:1.0:1789601726.278208:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789601726.278216:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918440960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789601726.278246:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789601726.278305:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918440960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601726.278311:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789601726.278326:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789601726.278333:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918440832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601726.278348:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789601726.278378:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918440832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601726.278384:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789601726.278794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918440832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789601726.278937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918440960:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601726.469756:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601726.790755:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918441088:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.790825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.790862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918441600:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.790887:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.790904:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918442112:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.790926:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.790952:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789601726.790958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918441216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.790977:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.790995:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918441728:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791013:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918442240:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791052:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918441344:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791118:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791135:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918441856:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918442368:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791222:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789601726.791228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918441472:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791248:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791259:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918441984:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791276:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601726.791312:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441088 00000100:00100000:0.0:1789601726.791320:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441088 00000100:00100000:0.0:1789601726.791364:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601726.791373:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:3645:x1876532918441088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791422:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0068b5de-bd03-471c-817a-758c66ef4c46+24:3645:x1876532918441088:12345-0@lo:400:kworker.0 Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791429:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789601726.791460:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442112 00000100:00100000:0.0:1789601726.791464:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442112 00000100:00100000:0.0:1789601726.791491:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442240 00000100:00100000:0.0:1789601726.791494:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442240 00000100:00100000:0.0:1789601726.791504:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441856 00000100:00100000:0.0:1789601726.791506:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441856 00000100:00100000:0.0:1789601726.791514:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442368 00000100:00100000:0.0:1789601726.791516:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442368 00000100:00100000:0.0:1789601726.791524:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441472 00000100:00100000:0.0:1789601726.791527:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441472 00000100:00100000:0.0:1789601726.791535:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441984 00000100:00100000:0.0:1789601726.791537:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441984 00000100:00100000:0.0:1789601726.791548:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601726.791576:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918442112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791609:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876532918442112:12345-0@lo:400:kworker.0 Request processed in 54us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791624:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601726.791638:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601726.791644:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918442240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791672:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876532918442240:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791678:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601726.791690:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601726.791695:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918441856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791726:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876532918441856:12345-0@lo:400:kworker.0 Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791732:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601726.791744:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601726.791750:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918442368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791775:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876532918442368:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791780:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601726.791789:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601726.791794:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791815:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876532918441472:12345-0@lo:400:kworker.0 Request processed in 21us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791819:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601726.791828:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601726.791833:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791858:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876532918441984:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791869:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601726.791888:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441600 00000100:00100000:0.0:1789601726.791892:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441600 00000100:00100000:0.0:1789601726.791909:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441216 00000100:00100000:0.0:1789601726.791911:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441216 00000100:00100000:0.0:1789601726.791919:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441728 00000100:00100000:0.0:1789601726.791921:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441728 00000100:00100000:0.0:1789601726.791931:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918441344 00000100:00100000:0.0:1789601726.791934:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918441344 00000100:00100000:0.0:1789601726.791945:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601726.791950:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918441600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.791983:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918441600:12345-0@lo:400:kworker.0 Request processed in 32us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.791989:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601726.792000:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601726.792006:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918441216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792032:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918441216:12345-0@lo:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.792037:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601726.792048:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601726.792053:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792078:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876532918441728:12345-0@lo:400:kworker.0 Request processed in 25us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.792083:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601726.792105:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601726.792111:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918441344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792161:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918441344:12345-0@lo:400:kworker.0 Request processed in 49us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601726.792167:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789601726.792199:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601726.792202:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601726.792205:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601726.792207:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789601726.792232:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876532918441472:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876532918441984:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918441344:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792258:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876532918441856:0@lo:400:kworker.0 00010000:00080000:0.0:1789601726.792268:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1944a80 x1876532918442368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601726.792278:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876532918442368:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918441216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918441728:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792337:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876532918442240:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0068b5de-bd03-471c-817a-758c66ef4c46:3645:1876532918441088:0@lo:400:kworker.0 00000100:00100000:0.0:1789601726.792353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876532918441600:0@lo:400:kworker.0 00010000:00080000:0.0:1789601726.792362:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df3c1947b80 x1876532918442112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601726.792370:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876532918442112:0@lo:400:kworker.0 00000100:00100000:1.0:1789601726.794821:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918442752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789601726.794881:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601726.794922:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601726.794928:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918442624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601726.794949:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601726.794979:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442752 00000100:00100000:1.0:1789601726.794993:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442752 00000100:00100000:1.0:1789601726.795026:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442624 00000100:00100000:1.0:1789601726.795029:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442624 00000100:00100000:1.0:1789601726.795045:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601726.795052:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918442752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789601726.795079:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789601726.795135:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918442752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601726.795142:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601726.795157:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601726.795163:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918442624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601726.795171:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789601726.795195:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918442624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601726.795201:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601726.795243:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918442624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601726.795255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918442752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789601726.795726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601726.795738:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918442496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789601726.795769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601726.795798:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918442496 00000100:00100000:2.0:1789601726.795803:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918442496 00000100:00100000:2.0:1789601726.795829:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601726.795835:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918442496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789601726.795846:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601726.795879:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876532918442496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601726.795891:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601726.795926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876532918442496:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789601727.366278:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601727.493854:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601727.778283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601727.778331:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601727.778370:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425600 00000100:00100000:3.0:1789601727.778376:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601727.778393:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425600 00000100:00100000:3.0:1789601727.778415:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601727.778443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601727.778463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601727.778480:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601727.778500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601727.778510:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426112 00000100:00100000:2.0:1789601727.778516:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426112 00000100:00100000:3.0:1789601727.778524:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601727.778553:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426624 00000100:00100000:2.0:1789601727.778593:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426624 00000100:00100000:3.0:1789601727.778611:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425984 00000100:00100000:2.0:1789601727.778614:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426496 00000100:00100000:2.0:1789601727.778617:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426496 00000100:00100000:3.0:1789601727.778632:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425984 00000100:00100000:2.0:1789601727.778636:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601727.778648:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898426112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601727.778665:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:3.0:1789601727.778675:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c36d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601727.778730:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898426112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601727.778737:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789601727.778757:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1789601727.778763:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426496:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601727.778836:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425856 00000100:00100000:1.0:1789601727.778849:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425856 00000100:00100000:1.0:1789601727.778874:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426368 00000100:00100000:1.0:1789601727.778878:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426368 00000100:00100000:1.0:1789601727.778890:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898425728 00000100:00100000:1.0:1789601727.778892:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898425728 00000100:00100000:1.0:1789601727.778903:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426240 00000100:00100000:1.0:1789601727.778905:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426240 00000100:00100000:1.0:1789601727.778919:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:1.0:1789601727.778925:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898425856:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601727.778994:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601727.779005:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:2415:x1876532898425600:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789601727.779029:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c36d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 353us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601727.779037:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:436a5db0-0172-499e-8bf1-5cb020bea989+13:2415:x1876532898425600:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 34us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601727.779040:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1789601727.779056:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789601727.779099:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789601727.779107:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898425984:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601727.779136:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898425984:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601727.779143:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789601727.779172:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789601727.779181:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601727.779210:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601727.779217:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789601727.779236:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789601727.779244:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2415:x1876532898425728:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601727.779289:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2415:x1876532898425728:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 45us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601727.779295:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789601727.779312:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:0.0:1789601727.779327:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2415:x1876532898426240:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601727.779354:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2415:x1876532898426240:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601727.779360:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00080000:0.0:1789601727.779471:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601727.779476:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601727.779479:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601727.779482:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601727.781024:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2415:x1876532898426496:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 2251us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601727.781035:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789601727.781610:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2415:x1876532898425856:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 2681us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601727.781620:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00010000:00010000:3.0:1789601728.520496:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601728.569067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.570059:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426752 00000100:00100000:2.0:1789601728.570087:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426752 00000100:00100000:2.0:1789601728.570180:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789601728.570193:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+6:15585:x1876532898426752:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601728.570213:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601728.570233:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f88 expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570322:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570337:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570349:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570397:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570405:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570413:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570490:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c000/0x74872e3eca9f2c24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570499:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c000/0x74872e3eca9f2c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570506:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c000/0x74872e3eca9f2c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601728.570538:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789601728.570542:0:19998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601728.570617:0:19998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c000/0x74872e3eca9f2c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570639:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570646:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570653:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570659:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737da00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601728.570662:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570670:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570682:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:2.0:1789601728.570685:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601728.570690:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570697:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2c16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570711:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570717:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570723:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570735:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737d200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601728.570739:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570745:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570753:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df3c3418000) 00010000:00010000:2.0:1789601728.570756:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601728.570759:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570765:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570799:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f88 expref: 8 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570814:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c000/0x74872e3eca9f2c24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f88 expref: 7 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.570821:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df3c3418f00) 00010000:00010000:2.0:1789601728.570824:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601728.570826:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c000, rc 0) 00000100:00100000:2.0:1789601728.570910:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15585:x1876532898426752:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 707us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.570919:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:3.0:1789601728.575878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.579156:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898426880 00000100:00100000:2.0:1789601728.579187:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898426880 00000100:00100000:2.0:1789601728.579268:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789601728.579279:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15585:x1876532898426880:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789601728.579368:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15585:x1876532898426880:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 91us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.579376:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789601728.583874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601728.583965:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427136 00000100:00100000:1.0:1789601728.583981:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427136 00000100:00100000:1.0:1789601728.584049:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1789601728.584060:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15585:x1876532898427136:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601728.584090:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601728.584113:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f8f expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584198:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584213:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584225:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584286:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584295:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584302:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584422:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e400/0x74872e3eca9f2c40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584443:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e400/0x74872e3eca9f2c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584451:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e400/0x74872e3eca9f2c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601728.584461:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789601728.584645:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584653:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584660:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584666:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212e000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601728.584670:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584678:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584689:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df3c3418f00) 00010000:00010000:1.0:1789601728.584692:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601728.584697:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584703:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e000/0x74872e3eca9f2c32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584715:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584727:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584732:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584736:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212fa00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:1.0:1789601728.584739:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584745:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584752:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df4d9368600) 00010000:00010000:1.0:1789601728.584754:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601728.584756:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.584762:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2c39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.588350:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f8f expref: 10 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.588390:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e400/0x74872e3eca9f2c40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f8f expref: 9 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.588400:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4d9368f00) 00010000:00010000:1.0:1789601728.588404:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601728.588423:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c212e400, rc 0) 00000100:00100000:1.0:1789601728.588499:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15585:x1876532898427136:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 4439us (4638us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789601728.588508:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789601728.601385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.601493:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427264 00000100:00100000:2.0:1789601728.601512:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427264 00000100:00100000:2.0:1789601728.601644:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789601728.601657:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15585:x1876532898427264:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789601728.601802:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15585:x1876532898427264:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.601821:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:3.0:1789601728.604635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.604741:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427392 00000100:00100000:2.0:1789601728.604758:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427392 00000100:00100000:2.0:1789601728.604852:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:2.0:1789601728.604865:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:15585:x1876532898427392:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789601728.609720:0:17045:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4803us 00000100:00100000:3.0:1789601728.624607:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:15585:x1876532898427392:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 19737us (19972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601728.624621:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789601728.656667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601728.661348:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427520 00000100:00100000:0.0:1789601728.661364:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427520 00000100:00100000:0.0:1789601728.661439:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601728.661459:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15591:x1876532898427520:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601728.661481:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601728.661504:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2c4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f96 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661581:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661595:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661605:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661619:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661625:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661645:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661688:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661696:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661703:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661708:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601728.661712:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661719:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661731:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:0.0:1789601728.661734:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601728.661739:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661745:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2c55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661758:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661764:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661776:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661781:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b7000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601728.661783:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661790:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661797:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4e1615600) 00010000:00010000:0.0:1789601728.661800:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601728.661802:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661808:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2c5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661839:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2c4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f96 expref: 10 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661849:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:0.0:1789601728.661852:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601728.661855:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2c4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f96 expref: 10 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601728.661864:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b6200, rc 0) 00000100:00100000:0.0:1789601728.661933:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15591:x1876532898427520:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 485us (5275us total) trans 0 rc 301/301 00000100:00100000:0.0:1789601728.661951:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601728.673917:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601728.674046:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427648 00000100:00100000:1.0:1789601728.674062:0:17054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427648 00000100:00100000:1.0:1789601728.674145:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1789601728.674162:0:17054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15591:x1876532898427648:12345-192.168.203.48@tcp:700:lfs.0 00000100:00100000:1.0:1789601728.674266:0:17054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15591:x1876532898427648:12345-192.168.203.48@tcp:700:lfs.0 Request processed in 109us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601728.674273:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789601728.684868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601728.684974:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898427904 00000100:00100000:1.0:1789601728.684983:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898427904 00000100:00100000:1.0:1789601728.685042:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789601728.685053:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+9:15591:x1876532898427904:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:1.0:1789601728.685116:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601728.685142:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2b7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f03 expref: 9 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.685161:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:1.0:1789601728.685166:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601728.685230:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.685245:0:17047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 5 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.685253:0:17047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.685296:0:17047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 5 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.685310:0:17047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 5 pid: 17046 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601728.685324:0:17047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17047:1876532918442880:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789601728.685403:0:17047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601728.691329:0:17047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c359fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17047:1876532918442880:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789601728.691358:0:17047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601728.693735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601728.694321:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428032 00000100:00100000:1.0:1789601728.694331:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428032 00010000:00010000:1.0:1789601728.694374:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 6 pid: 17046 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601728.694422:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1789601728.694437:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2416:x1876532898428032:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601728.694692:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601728.694701:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 6 pid: 17046 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694714:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 6 pid: 17046 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694753:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2bbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f73 expref: 6 pid: 17046 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694768:0:17031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:1.0:1789601728.694773:0:17031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694782:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694789:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.694817:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601728.694860:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898428032:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 430us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601728.694866:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:3.0:1789601728.694921:0:17047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.694930:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.694954:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.694963:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.694978:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696110:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696124:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696132:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601728.696148:0:17047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005292f742 reply state 00000000ba0158f8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696158:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696164:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.696167:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601728.696169:0:17047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601728.696174:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789601728.696181:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696188:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696195:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696200:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212f800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.696209:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696217:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696225:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c341a000) 00010000:00010000:3.0:1789601728.696228:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.696231:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696237:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f800/0x74872e3eca9f2c63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601728.696254:0:17047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005292f742 reply state 00000000ba0158f8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696262:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.696267:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4f3972a00) 00010000:00010000:3.0:1789601728.696270:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601728.696271:0:17047:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789601728.696329:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+10:15591:x1876532898427904:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 11278us (11468us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789601728.696336:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601728.813987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.814103:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428160 00000100:00100000:2.0:1789601728.814112:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428160 00000100:00100000:2.0:1789601728.814173:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:2.0:1789601728.814183:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+10:15599:x1876532898428160:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:2.0:1789601728.814205:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601728.814228:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48f9d expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814291:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814317:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814329:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601728.814370:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789601728.814374:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601728.814411:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814436:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f9d expref: 12 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814455:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737d200/0x74872e3eca9f2c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48f9d expref: 11 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601728.814463:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:2.0:1789601728.814466:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601728.814469:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737d200, rc 0) 00000100:00100000:2.0:1789601728.814544:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+11:15599:x1876532898428160:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 362us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.814552:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789601728.857845:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.858000:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428288 00000100:00100000:3.0:1789601728.858011:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428288 00000100:00100000:3.0:1789601728.858080:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:3.0:1789601728.858090:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:15600:x1876532898428288:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601728.858111:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.858143:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2c86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fa4 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858204:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2c8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858217:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2c8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858229:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2c8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601728.858271:0:17045:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601728.858275:0:17045:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601728.858294:0:17045:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2c8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858319:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2c86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fa4 expref: 7 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858337:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383e00/0x74872e3eca9f2c8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fa4 expref: 6 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.858344:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:3.0:1789601728.858347:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601728.858350:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383e00, rc 0) 00000100:00100000:3.0:1789601728.858826:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15600:x1876532898428288:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 736us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601728.858834:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:0.0:1789601728.862313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.862391:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428416 00000100:00100000:3.0:1789601728.862415:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428416 00000100:00100000:3.0:1789601728.862490:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1789601728.862501:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:15600:x1876532898428416:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601728.862519:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.862538:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fab expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862840:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862856:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862867:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862879:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862887:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862893:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862974:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862983:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.862990:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601728.863035:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601728.863038:0:19998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601728.863056:0:19998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863068:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863087:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863094:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863099:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.863104:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863110:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863123:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:3.0:1789601728.863126:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.863130:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863136:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863150:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863165:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863171:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863175:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.863178:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863185:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863193:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4f3972a00) 00010000:00010000:3.0:1789601728.863196:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.863199:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863205:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2ca2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863232:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fab expref: 8 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863246:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fab expref: 7 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.863252:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.863254:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601728.863262:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383000, rc 0) 00000100:00100000:3.0:1789601728.863321:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+7:15600:x1876532898428416:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 822us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601728.863329:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1789601728.867842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.867936:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428544 00000100:00100000:2.0:1789601728.867945:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428544 00000100:00100000:2.0:1789601728.868003:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789601728.868013:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:15600:x1876532898428544:12345-192.168.203.48@tcp:900:lfs.0 00000100:00100000:2.0:1789601728.868101:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:15600:x1876532898428544:12345-192.168.203.48@tcp:900:lfs.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.868122:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789601728.872239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601728.872335:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898428800 00000100:00100000:1.0:1789601728.872344:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898428800 00000100:00100000:1.0:1789601728.872403:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:1.0:1789601728.872413:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+7:15600:x1876532898428800:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789601728.872432:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601728.872454:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fb2 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601728.872907:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789601728.873003:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2cb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fb2 expref: 9 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.873028:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:1.0:1789601728.873031:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601728.873036:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212fa00/0x74872e3eca9f2cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fb2 expref: 9 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601728.873048:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c212fa00, rc 0) 00000100:00100000:1.0:1789601728.873118:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+8:15600:x1876532898428800:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 707us (889us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789601728.873126:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:0.0:1789601728.876902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.876997:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898429056 00000100:00100000:3.0:1789601728.877007:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898429056 00000100:00100000:3.0:1789601728.877065:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1789601728.877087:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+8:15600:x1876532898429056:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1789601728.877138:0:19998:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601728.877164:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2ca9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fab expref: 8 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.877183:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.877189:0:19998:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601728.877209:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.877223:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.877232:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601728.877422:0:19998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000095d9591 reply state 00000000bc764c1b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.877436:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.877442:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.877457:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789601728.877461:0:19998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601728.877942:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789601728.878015:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+9:15600:x1876532898429056:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 940us (1121us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789601728.878023:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789601728.882449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.882610:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898429312 00000100:00100000:2.0:1789601728.882620:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898429312 00000100:00100000:2.0:1789601728.882673:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601728.882683:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+9:15600:x1876532898429312:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789601728.882900:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+10:15600:x1876532898429312:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 217us (459us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789601728.882916:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789601728.887193:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.887254:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898429568 00000100:00100000:3.0:1789601728.887263:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898429568 00000100:00100000:3.0:1789601728.887316:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789601728.887325:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+10:15600:x1876532898429568:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601728.887349:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.887366:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fb9 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887438:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887450:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887461:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887470:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887476:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887482:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601728.887810:0:17045:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789601728.887885:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887893:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887899:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887911:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.887915:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887922:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887933:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:3.0:1789601728.887936:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.887943:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887949:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887960:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887965:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887980:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887984:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.887987:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887992:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.887998:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4f3972a00) 00010000:00010000:3.0:1789601728.888000:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.888002:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.888007:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.888036:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fb9 expref: 12 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.888045:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:3.0:1789601728.888047:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601728.888050:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fb9 expref: 12 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.888057:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382e00, rc 0) 00000100:00100000:3.0:1789601728.888115:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+11:15600:x1876532898429568:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 791us (929us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789601728.888131:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:0.0:1789601728.891502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.891746:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898429696 00000100:00100000:3.0:1789601728.891756:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898429696 00000100:00100000:3.0:1789601728.891809:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789601728.891820:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+11:15600:x1876532898429696:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789601728.891842:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.891862:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2ce1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fc0 expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.891963:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.891977:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.891988:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601728.892013:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601728.892017:0:19998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601728.892036:0:19998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.892060:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2ce1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 13 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.892089:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 12 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.892116:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.892119:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601728.892123:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382a00, rc 0) 00000100:00100000:3.0:1789601728.892171:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+12:15600:x1876532898429696:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 353us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601728.892178:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:0.0:1789601728.897168:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.897406:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898429824 00000100:00100000:2.0:1789601728.897417:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898429824 00000100:00100000:2.0:1789601728.897467:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789601728.897482:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+12:15600:x1876532898429824:12345-192.168.203.48@tcp:37:lfs.0 00000100:00100000:2.0:1789601728.902898:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+12:15600:x1876532898429824:12345-192.168.203.48@tcp:37:lfs.0 Request processed in 5413us (5729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.902912:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1789601728.910080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.910156:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430080 00000100:00100000:3.0:1789601728.910166:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430080 00000100:00100000:3.0:1789601728.910220:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789601728.910230:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f7619050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+12:15600:x1876532898430080:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601728.910448:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f7619050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+13:15600:x1876532898430080:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 218us (385us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789601728.910455:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789601728.978672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.978765:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430208 00000100:00100000:3.0:1789601728.978776:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430208 00000100:00100000:3.0:1789601728.978839:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789601728.978849:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+11:15606:x1876532898430208:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601728.978869:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.978889:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2cef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fc7 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.978958:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.978972:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.978997:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979010:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979018:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979024:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979108:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2d04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979117:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2d04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979124:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2d04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601728.979156:0:17045:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789601728.979160:0:17045:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789601728.979197:0:17045:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2d04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979209:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979216:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979233:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979239:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.979244:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979252:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979264:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:3.0:1789601728.979267:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.979272:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979279:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979293:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979299:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979305:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979310:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601728.979313:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979328:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979337:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4f3972a00) 00010000:00010000:3.0:1789601728.979339:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601728.979342:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979348:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2cfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979375:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc7 expref: 13 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979388:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382200/0x74872e3eca9f2d04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc7 expref: 12 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.979395:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601728.979397:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789601728.979399:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7382200, rc 0) 00000100:00100000:3.0:1789601728.979458:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+12:15606:x1876532898430208:12345-192.168.203.48@tcp:101:bash.0 Request processed in 609us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601728.979465:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789601728.984681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601728.984811:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430336 00000100:00100000:2.0:1789601728.984821:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430336 00000100:00100000:2.0:1789601728.984955:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601728.984966:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:15606:x1876532898430336:12345-192.168.203.48@tcp:900:bash.0 00000100:00100000:2.0:1789601728.985046:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:15606:x1876532898430336:12345-192.168.203.48@tcp:900:bash.0 Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601728.985054:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789601728.994244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601728.994323:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430592 00000100:00100000:3.0:1789601728.994333:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430592 00000100:00100000:3.0:1789601728.994396:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1789601728.994407:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+12:15606:x1876532898430592:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601728.994447:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601728.994469:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d0b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fce expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.994619:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.994634:0:19998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 12 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.994642:0:19998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.994675:0:19998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 12 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601728.994690:0:19998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 12 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601728.994703:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918443008:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601728.994774:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601728.996373:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c410df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918443008:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789601728.996397:0:19998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601729.000613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601729.000745:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430720 00000100:00100000:1.0:1789601729.000756:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430720 00010000:00010000:1.0:1789601729.000810:0:18578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 13 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601729.000850:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789601729.000861:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+13:2415:x1876532898430720:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601729.000876:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601729.000882:0:18578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 13 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.000897:0:18578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 13 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.000927:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382a00/0x74872e3eca9f2ce8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fc0 expref: 13 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.000962:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:1.0:1789601729.000968:0:18578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.000978:0:18578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.000986:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.001016:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601729.001066:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+12:2415:x1876532898430720:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 206us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601729.001084:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00010000:00010000:3.0:1789601729.001220:0:19998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001229:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001259:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001269:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001276:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001756:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001767:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001775:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601729.001785:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789601729.001810:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001818:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001824:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001830:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601729.001834:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001852:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001863:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:3.0:1789601729.001866:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601729.001870:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001876:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601729.001888:0:19998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000244fa46c reply state 00000000548f1f96 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001898:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001904:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df4f3972700) 00010000:00010000:3.0:1789601729.001907:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789601729.001910:0:19998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789601729.001944:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d0b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 15 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001959:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 14 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.001966:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.001967:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789601729.001970:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383000, rc 0) 00000100:00100000:3.0:1789601729.002016:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+15:15606:x1876532898430592:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7611us (7782us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789601729.002024:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00080000:0.0:1789601729.002704:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601729.031244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601729.031344:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898430848 00000100:00100000:3.0:1789601729.031355:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898430848 00000100:00100000:3.0:1789601729.031428:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:3.0:1789601729.031438:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+15:15606:x1876532898430848:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789601729.031463:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601729.031492:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fd5 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.031833:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.031859:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.031871:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601729.031931:0:17045:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789601729.031935:0:17045:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601729.031957:0:17045:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.031969:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.031994:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 17 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.032011:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 16 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.032019:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601729.032022:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601729.032026:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c400, rc 0) 00000100:00100000:2.0:1789601729.032103:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+16:15606:x1876532898430848:12345-192.168.203.48@tcp:101:bash.0 Request processed in 666us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601729.032112:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00080000:0.0:1789601729.032245:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601729.035415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.035499:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898431104 00000100:00100000:2.0:1789601729.035509:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898431104 00000100:00100000:3.0:1789601729.035701:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789601729.035714:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+16:15606:x1876532898431104:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:3.0:1789601729.036005:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+17:15606:x1876532898431104:12345-192.168.203.48@tcp:35:bash.0 Request processed in 294us (598us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789601729.036013:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789601729.154011:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601729.154273:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898431360 00000100:00100000:0.0:1789601729.154287:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898431360 00000100:00100000:0.0:1789601729.154549:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1789601729.154606:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+17:15616:x1876532898431360:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789601729.154641:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601729.154668:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7600/0x74872e3eca9f2d3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fdc expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601729.154855:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789601729.155706:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7600/0x74872e3eca9f2d3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fdc expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.155725:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df3c3418000) 00010000:00010000:0.0:1789601729.155729:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601729.155735:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7600/0x74872e3eca9f2d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fdc expref: 19 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.155754:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b7600, rc 0) 00000100:00100000:0.0:1789601729.155964:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+18:15616:x1876532898431360:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1345us (1910us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789601729.155974:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000040:00080000:2.0:1789601729.160294:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789601729.160311:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601729.160402:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898431616 00000100:00100000:3.0:1789601729.160416:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898431616 00000100:00100000:3.0:1789601729.160491:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789601729.160504:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+18:15616:x1876532898431616:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789601729.161200:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+19:15616:x1876532898431616:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 697us (901us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789601729.161210:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1789601729.206936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.209697:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898431872 00000100:00100000:2.0:1789601729.209714:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898431872 00000100:00100000:2.0:1789601729.209856:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1789601729.209867:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+19:15619:x1876532898431872:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789601729.209891:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601729.209916:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2d4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fe3 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.210030:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2d51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.210045:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.210058:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601729.210081:0:17045:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789601729.210194:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2d4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fe3 expref: 22 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.210213:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fe3 expref: 21 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.210222:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601729.210225:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601729.210229:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c200, rc 0) 00000100:00100000:2.0:1789601729.210292:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+21:15619:x1876532898431872:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 427us (3363us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789601729.210314:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789601729.226436:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601729.226489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601729.226688:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898432000 00000100:00100000:0.0:1789601729.226702:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898432000 00000100:00100000:0.0:1789601729.226781:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789601729.226804:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+21:2415:x1876532898432000:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601729.226823:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601729.226860:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2d51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fe3 expref: 21 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.226884:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:0.0:1789601729.226890:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601729.226987:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+20:2415:x1876532898432000:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 178us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601729.227015:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789601729.227367:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898432128 00000100:00100000:3.0:1789601729.227392:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898432128 00000100:00100000:3.0:1789601729.227437:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789601729.227446:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15619:x1876532898432128:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789601729.227771:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227799:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227814:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227859:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227866:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227874:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227880:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383a00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601729.227885:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227892:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.227903:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.228237:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601729.228246:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.228269:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601729.228358:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15619:x1876532898432128:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 911us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601729.228368:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1789601729.233225:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.233342:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898432384 00000100:00100000:2.0:1789601729.233358:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898432384 00000100:00100000:2.0:1789601729.233623:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789601729.233636:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15619:x1876532898432384:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789601729.233865:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+21:15619:x1876532898432384:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 231us (656us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789601729.233873:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000040:00080000:1.0:1789601729.414905:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601729.541897:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601729.545835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601729.545954:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898432640 00000100:00100000:1.0:1789601729.545967:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898432640 00000100:00100000:1.0:1789601729.546051:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:1.0:1789601729.546062:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+21:15650:x1876532898432640:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:1.0:1789601729.546105:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601729.546137:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2d66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fea expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.546337:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2d6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.546356:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2d6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.546371:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2d6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601729.546385:0:17047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789601729.546622:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2d66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fea expref: 24 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.546644:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2d6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fea expref: 23 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601729.546654:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:1.0:1789601729.546657:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601729.546662:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df3c212f000, rc 0) 00000100:00100000:1.0:1789601729.546743:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15650:x1876532898432640:12345-192.168.203.48@tcp:101:cat.0 Request processed in 682us (923us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789601729.546752:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:1.0:1789601729.552879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601729.552953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601729.553085:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433024 00000100:00100000:3.0:1789601729.553101:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433024 00000100:00100000:3.0:1789601729.553187:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789601729.553209:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+23:2415:x1876532898433024:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601729.553229:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601729.553260:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2d6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fea expref: 23 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.553283:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.553302:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601729.553378:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+22:2415:x1876532898433024:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 181us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601729.553386:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1789601729.554236:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898432896 00000100:00100000:2.0:1789601729.554245:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898432896 00000100:00100000:2.0:1789601729.554313:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:2.0:1789601729.554323:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+22:15650:x1876532898432896:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:2.0:1789601729.555912:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15650:x1876532898432896:12345-192.168.203.48@tcp:35:cat.0 Request processed in 1577us (3035us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789601729.555941:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1789601729.650499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601729.654688:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433280 00000100:00100000:0.0:1789601729.654710:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433280 00000100:00100000:0.0:1789601729.654819:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789601729.654833:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15656:x1876532898433280:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:0.0:1789601729.654868:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601729.654901:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2d7b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ff1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655234:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655254:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 24 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655263:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 24 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655273:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655319:0:17046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 24 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655335:0:17046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 24 pid: 17045 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601729.655375:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17046:1876532918443136:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601729.655693:0:17046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 24 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.655703:0:17046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 24 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601729.655714:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17046:1876532918443264:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601729.655743:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df3c23ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1789601729.661267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601729.661326:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.661443:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433408 00000100:00100000:2.0:1789601729.661457:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433408 00010000:00010000:2.0:1789601729.661521:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 25 pid: 17045 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601729.661611:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433536 00000100:00100000:2.0:1789601729.661615:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433536 00010000:00010000:2.0:1789601729.661630:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 26 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601729.661668:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789601729.661679:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+26:2416:x1876532898433408:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601729.661701:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601729.661710:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 26 pid: 17045 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.661728:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 26 pid: 17045 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601729.661732:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789601729.661749:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c2241c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+26:2416:x1876532898433536:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601729.661760:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601729.661765:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.661767:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 26 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.661774:0:17032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.661787:0:17032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.661804:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601729.661872:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+26:2416:x1876532898433408:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 194us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601729.661880:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00010000:00010000:3.0:1789601729.664223:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 25 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.664266:0:17031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.664273:0:17031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.664285:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.664295:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.664337:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601729.664544:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2d35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fd5 expref: 25 pid: 17045 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601729.664607:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17046:1876532918443136:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601729.664624:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383000/0x74872e3eca9f2d20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fce expref: 24 pid: 19998 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601729.664635:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17046:1876532918443264:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601729.664662:0:17046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.664673:0:17046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.664679:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601729.664729:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:3.0:1789601729.665137:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c2241c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+25:2416:x1876532898433536:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 3389us (3806us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601729.665138:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2d7b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff1 expref: 25 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601729.665161:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00010000:00010000:0.0:1789601729.665169:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6800/0x74872e3eca9f2d82 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff1 expref: 24 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.665179:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:0.0:1789601729.665183:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601729.665186:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b6800, rc 0) 00000100:00100000:0.0:1789601729.665228:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15656:x1876532898433280:12345-192.168.203.48@tcp:101:dd.0 Request processed in 10398us (14748us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789601729.665237:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1789601729.669309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601729.669419:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433664 00000100:00100000:3.0:1789601729.669433:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433664 00000100:00100000:3.0:1789601729.670231:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:3.0:1789601729.670245:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15656:x1876532898433664:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789601729.670279:0:17047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601729.670305:0:17047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48ff8 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.670351:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.670390:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.670403:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.675380:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383a00/0x74872e3eca9f2d90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 25 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.675421:0:17047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 24 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601729.675432:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601729.675435:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601729.675440:0:17047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f7383400, rc 0) 00000100:00100000:3.0:1789601729.676289:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+24:15656:x1876532898433664:12345-192.168.203.48@tcp:101:dd.0 Request processed in 6035us (6985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601729.676303:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:2.0:1789601729.680173:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601729.680271:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898433920 00000100:00100000:3.0:1789601729.680287:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898433920 00000100:00100000:3.0:1789601729.680367:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789601729.680379:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+24:15656:x1876532898433920:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:2.0:1789601729.681035:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.681058:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.681104:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601729.681158:0:19998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789601729.681186:0:19998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf73bfa1 reply state 00000000678436f6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.681201:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.681209:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601729.681212:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789601729.681217:0:19998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601729.681342:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898433920:12345-192.168.203.48@tcp:36:dd.0 Request processed in 964us (1182us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789601729.681350:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000020:00080000:2.0:1789601729.681357:0:19998:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789601729.689384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601729.689505:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434048 00000100:00100000:0.0:1789601729.689519:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434048 00000100:00100000:0.0:1789601729.689687:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789601729.689701:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898434048:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:0.0:1789601729.689732:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601729.689758:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2da5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a48fff expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.689830:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2da5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fff expref: 28 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.689847:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2da5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fff expref: 28 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.689894:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:0.0:1789601729.689907:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601729.689912:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b6600, rc 0) 00000100:00100000:0.0:1789601729.689982:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15656:x1876532898434048:12345-192.168.203.48@tcp:101:dd.0 Request processed in 285us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601729.689989:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1789601729.704709:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.704907:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434304 00000100:00100000:2.0:1789601729.704920:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434304 00000100:00100000:2.0:1789601729.704998:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601729.705011:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15656:x1876532898434304:12345-192.168.203.48@tcp:103:dd.0 00010000:00010000:2.0:1789601729.705032:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601729.705078:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6600/0x74872e3eca9f2da5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48fff expref: 28 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.705100:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601729.705107:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601729.705311:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898434304:12345-192.168.203.48@tcp:103:dd.0 Request processed in 301us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601729.705321:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789601729.708860:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601729.709021:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434432 00000100:00100000:0.0:1789601729.709033:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434432 00000100:00100000:0.0:1789601729.709145:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1789601729.709157:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898434432:12345-192.168.203.48@tcp:58:dd.0 00010000:00010000:0.0:1789601729.709299:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.709320:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601729.709335:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601729.710993:0:17046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601729.711306:0:17046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789601729.711516:0:17046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789601729.711987:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898434432:12345-192.168.203.48@tcp:58:dd.0 Request processed in 2825us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601729.712001:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789601729.713943:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601729.714387:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434560 00000100:00100000:2.0:1789601729.714400:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434560 00000100:00100000:2.0:1789601729.714488:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:2.0:1789601729.714499:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+27:15656:x1876532898434560:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:2.0:1789601729.714526:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601729.714553:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49006 expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714652:0:19998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714665:0:19998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 28 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714690:0:19998:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714707:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 28 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714723:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601729.714727:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601729.714731:0:19998:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 28 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601729.714760:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737dc00, rc 0) 00000100:00100000:2.0:1789601729.714831:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15656:x1876532898434560:12345-192.168.203.48@tcp:101:dd.0 Request processed in 333us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601729.714838:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000040:00080000:2.0:1789601730.182998:0:17081:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789601730.183011:0:17081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601730.183051:0:17081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789601730.183076:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789601730.183277:0:17081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17081:1876532918443392:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601730.183477:0:17081:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601730.199408:0:17081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3434000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17081:1876532918443392:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601730.199503:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.199646:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434688 00000100:00100000:0.0:1789601730.199655:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434688 00000100:00100000:0.0:1789601730.199740:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1789601730.199752:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15657:x1876532898434688:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789601730.199797:0:17045:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789601730.199975:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15657:x1876532898434688:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 224us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.199984:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1789601730.221239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.221521:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898434816 00000100:00100000:0.0:1789601730.221536:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898434816 00000100:00100000:0.0:1789601730.221654:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1789601730.221669:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15657:x1876532898434816:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789601730.221773:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.221797:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.221815:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.221834:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.221842:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.221849:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222060:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222164:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222172:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601730.222232:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789601730.222237:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789601730.222255:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222267:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222274:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222281:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222288:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.222293:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222302:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222316:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4d9368f00) 00010000:00010000:0.0:1789601730.222320:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.222326:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222343:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2dba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222361:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222368:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222374:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222379:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b7000 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.222382:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222388:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222396:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8df4e1615600) 00010000:00010000:0.0:1789601730.222399:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.222402:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222408:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2dc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222423:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222430:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222442:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222448:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.222451:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222456:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222464:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:0.0:1789601730.222466:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.222469:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.222474:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2dc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.222679:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15657:x1876532898434816:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1010us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.222690:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1789601730.244282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.248257:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898435072 00000100:00100000:2.0:1789601730.248279:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898435072 00000100:00100000:2.0:1789601730.248383:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789601730.248397:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+28:15657:x1876532898435072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.248424:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601730.248451:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2dcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a4900d expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248617:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248640:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248656:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601730.248689:0:19998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789601730.248814:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248822:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248829:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248837:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601730.248842:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.248850:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.249089:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601730.249258:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601730.249266:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.249274:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2dd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.249331:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2dcf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4900d expref: 30 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.249343:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df4d9368f00) 00010000:00010000:2.0:1789601730.249346:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601730.249360:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2dcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4900d expref: 30 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.249372:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737da00, rc 0) 00000100:00100000:2.0:1789601730.249468:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c4066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+29:15657:x1876532898435072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1075us (5200us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789601730.249477:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:3.0:1789601730.255533:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.255981:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898435200 00000100:00100000:1.0:1789601730.255994:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898435200 00000100:00100000:1.0:1789601730.256134:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789601730.256147:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+29:15657:x1876532898435200:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789601730.256196:0:17047:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789601730.256354:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+29:15657:x1876532898435200:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 209us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601730.256361:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1789601730.271129:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.271360:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898435456 00000100:00100000:0.0:1789601730.271374:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898435456 00000100:00100000:0.0:1789601730.271455:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1789601730.271467:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+29:15657:x1876532898435456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601730.271495:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601730.271522:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2de4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49014 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601730.272103:0:17045:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1789601730.272112:0:17045:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789601730.272134:0:17045:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789601730.272317:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2deb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.272334:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2deb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.272346:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2deb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.272416:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2de4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49014 expref: 32 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.272440:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2deb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49014 expref: 31 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.272450:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615600) 00010000:00010000:0.0:1789601730.272453:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601730.272458:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b7000, rc 0) 00000100:00100000:0.0:1789601730.272537:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+31:15657:x1876532898435456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1071us (1422us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789601730.272546:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789601730.282496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.282734:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898435712 00000100:00100000:0.0:1789601730.282749:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898435712 00000100:00100000:0.0:1789601730.282826:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1789601730.282838:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+31:15657:x1876532898435712:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789601730.282935:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601730.282971:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7000/0x74872e3eca9f2deb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49014 expref: 31 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.282996:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615600) 00010000:00010000:0.0:1789601730.283007:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601730.283034:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283051:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283073:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283089:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283190:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283198:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283262:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283269:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283276:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283289:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.283294:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283302:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283311:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:0.0:1789601730.283313:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.283318:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283324:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6e00/0x74872e3eca9f2df9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283334:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283340:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283346:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283351:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.283354:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283359:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283374:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6bf1207b (ffff8df4e1615100) 00010000:00010000:0.0:1789601730.283377:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.283379:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.283386:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6bf1207b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.283522:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+30:15657:x1876532898435712:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 685us (1042us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601730.283530:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1789601730.290442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.290651:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898435840 00000100:00100000:0.0:1789601730.290665:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898435840 00000100:00100000:0.0:1789601730.290745:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789601730.290758:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+30:15657:x1876532898435840:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601730.290786:0:17045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601730.290817:0:17045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7e00/0x74872e3eca9f2e07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a4901b expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.290865:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7200/0x74872e3eca9f2e0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.290882:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7200/0x74872e3eca9f2e0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.290897:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7200/0x74872e3eca9f2e0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17045 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.291039:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7e00/0x74872e3eca9f2e07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4901b expref: 32 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.291084:0:17045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7200/0x74872e3eca9f2e0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4901b expref: 31 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.291230:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:0.0:1789601730.291235:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601730.291239:0:17045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b7200, rc 0) 00000100:00100000:0.0:1789601730.291320:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+31:15657:x1876532898435840:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 565us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.291328:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789601730.296996:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.297128:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436096 00000100:00100000:1.0:1789601730.297141:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436096 00000100:00100000:1.0:1789601730.297215:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:1.0:1789601730.297228:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+31:15657:x1876532898436096:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601730.297336:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.297357:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.297373:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601730.297651:0:17047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789601730.297663:0:17047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 598419105971ns, next at 599419103174ns, rc = 0 00000004:00010000:1.0:1789601730.297725:0:17047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043cc0e0b reply state 00000000c7c75131 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.297741:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.297771:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:1.0:1789601730.297774:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789601730.297780:0:17047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601730.297916:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+33:15657:x1876532898436096:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 688us (934us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789601730.297924:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789601730.303235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.303360:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436224 00000100:00100000:2.0:1789601730.303375:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436224 00000100:00100000:2.0:1789601730.303456:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:2.0:1789601730.303469:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+33:15657:x1876532898436224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.303501:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601730.303528:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49022 expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.303666:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 34 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.303685:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 34 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.303709:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:2.0:1789601730.303713:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601730.303717:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737da00, rc 0) 00000100:00100000:2.0:1789601730.303797:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+34:15657:x1876532898436224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 330us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.303805:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789601730.306720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.306836:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436352 00000100:00100000:0.0:1789601730.306848:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436352 00000100:00100000:0.0:1789601730.306939:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789601730.306952:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898436352:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789601730.307290:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2416:x1876532898436352:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 340us (584us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789601730.307298:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00080000:2.0:1789601730.307924:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601730.322533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.322795:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436608 00000100:00100000:2.0:1789601730.322808:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436608 00000100:00100000:2.0:1789601730.322873:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1789601730.322884:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+34:15657:x1876532898436608:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789601730.323327:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+35:15657:x1876532898436608:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 443us (809us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789601730.323335:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789601730.330835:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601730.330953:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436864 00000100:00100000:3.0:1789601730.330968:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436864 00000100:00100000:3.0:1789601730.331127:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1789601730.331141:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+35:15657:x1876532898436864:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601730.331396:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+35:15657:x1876532898436864:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 256us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601730.331405:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789601730.335429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.335943:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898436992 00000100:00100000:2.0:1789601730.335956:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898436992 00000100:00100000:2.0:1789601730.336035:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789601730.336047:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+35:15657:x1876532898436992:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.336088:0:19998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601730.336307:0:19998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2e23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49029 expref: -99 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336405:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336423:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336437:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601730.336495:0:19998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789601730.336519:0:19998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336632:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c200/0x74872e3eca9f2e23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49029 expref: 37 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336655:0:19998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49029 expref: 36 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.336663:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:2.0:1789601730.336666:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789601730.336671:0:19998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c400, rc 0) 00000100:00100000:2.0:1789601730.337273:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+36:15657:x1876532898436992:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1225us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.337283:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789601730.341739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601730.347592:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898437120 00000100:00100000:3.0:1789601730.347615:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898437120 00000100:00100000:2.0:1789601730.347825:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1789601730.347841:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+6:2415:x1876532898437120:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.347868:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601730.347897:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49030 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601730.347934:0:18554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab27c2, blocks: 0x0 00010000:00010000:2.0:1789601730.347963:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=598s v=(0 0) 00010000:00010000:2.0:1789601730.347969:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601730.347980:0:18554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 7 pid: 18554 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.348031:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 7 pid: 18554 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.348048:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737c800, rc 0) 00000100:00100000:2.0:1789601730.348164:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2415:x1876532898437120:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (6439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.348171:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1789601730.351704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601730.351927:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898437376 00000100:00100000:3.0:1789601730.351940:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898437376 00000100:00100000:3.0:1789601730.352012:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789601730.352023:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+36:15657:x1876532898437376:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601730.352174:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+36:15657:x1876532898437376:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 152us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601730.352182:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789601730.357463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.357604:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898437504 00000100:00100000:0.0:1789601730.357617:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898437504 00000100:00100000:0.0:1789601730.357694:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1789601730.357708:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+36:15657:x1876532898437504:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789601730.361868:0:17025:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789601730.361890:0:17025:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789601730.362162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918443520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601730.362271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601730.362344:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918443520 00000100:00100000:3.0:1789601730.362353:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918443520 00000100:00100000:3.0:1789601730.362420:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601730.362431:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918443520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789601730.362652:0:19127:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789601730.362656:0:19127:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789601730.362659:0:19127:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789601730.362661:0:19127:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789601730 -> 1789601730 00002000:00010000:3.0:1789601730.362664:0:19127:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789601730.362713:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876532918443520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 284us (442us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789601730.362722:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789601730.362750:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789601730.362788:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df4cd0b9c00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789601730.362795:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4cd0b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918443520:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789601730.362992:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363005:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363023:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363030:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.363036:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363046:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363077:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df4f3972a00) 00010000:00010000:0.0:1789601730.363081:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.363087:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363107:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382600/0x74872e3eca9f2c6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363132:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363139:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363145:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363150:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7383600 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.363153:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363171:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363180:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:0.0:1789601730.363183:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.363187:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363193:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383600/0x74872e3eca9f2c71 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363208:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363214:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363219:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363224:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382e00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.363227:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363233:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363241:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df4f3972700) 00010000:00010000:0.0:1789601730.363243:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.363246:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363259:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382e00/0x74872e3eca9f2d19 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363277:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363284:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363291:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363297:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737de00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.363301:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363307:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363315:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:0.0:1789601730.363318:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601730.363320:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363326:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2d9e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363338:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363345:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363358:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363363:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df3c212e200 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:0.0:1789601730.363366:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363373:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363382:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:0.0:1789601730.363385:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789601730.363388:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.363394:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212e200/0x74872e3eca9f2e15 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601730.363672:0:17025:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789601730.363933:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4d09c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+15:15657:x1876532898437504:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 6225us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.363943:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1789601730.370993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.371097:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898437632 00000100:00100000:0.0:1789601730.371109:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898437632 00000100:00100000:0.0:1789601730.371183:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:0.0:1789601730.371196:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2416:x1876532898437632:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789601730.371351:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2416:x1876532898437632:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 156us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.371359:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00010000:00010000:2.0:1789601730.372635:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372651:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372660:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372667:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:2.0:1789601730.372672:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372682:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372703:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df4f3972300) 00010000:00010000:2.0:1789601730.372706:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789601730.372713:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.372736:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2cbe lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.376433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.376730:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898437888 00000100:00100000:1.0:1789601730.376744:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898437888 00000100:00100000:1.0:1789601730.377047:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1789601730.377075:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+15:15657:x1876532898437888:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601730.377155:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601730.377192:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49029 expref: 15 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.377215:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:1.0:1789601730.377221:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601730.377261:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2e38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.377279:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.377289:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601730.377870:0:17047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000522f5a64 reply state 00000000ee995a59 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.378291:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df3c212f000/0x74872e3eca9f2e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.378304:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:1.0:1789601730.378307:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789601730.378312:0:17047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601730.378653:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4cd0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+16:15657:x1876532898437888:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1409us (2051us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789601730.378665:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:3.0:1789601730.385760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.385952:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438016 00000100:00100000:0.0:1789601730.385966:0:19127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438016 00000100:00100000:0.0:1789601730.386045:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601730.386057:0:19127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+7:15657:x1876532898438016:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601730.386091:0:19127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601730.386115:0:19127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a49037 expref: -99 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.386154:0:19127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 8 pid: 18554 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.386165:0:19127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601730.386170:0:19127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601730.386176:0:19127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.386354:0:19127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 8 pid: 18554 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.386371:0:19127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 8 pid: 18554 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.386389:0:19127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19127:1876532918443648:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789601730.386951:0:19127:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73e59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601730.399454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.399607:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438144 00000100:00100000:1.0:1789601730.399620:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438144 00010000:00010000:1.0:1789601730.399675:0:18578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 9 pid: 18554 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.399725:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1789601730.399737:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+9:2415:x1876532898438144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601730.399757:0:18578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601730.399785:0:18578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 9 pid: 18554 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.399800:0:18578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 9 pid: 18554 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.399972:0:18578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601730.399977:0:18578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601730.399985:0:18578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 9 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.399998:0:18578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 9 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.400165:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015dedc39/0x74872e3eca9f2e31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49030 expref: 9 pid: 18554 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.400198:0:19127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19127:1876532918443648:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601730.400303:0:19127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.400318:0:19127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4fb6b6200, rc 0) 00010000:00010000:1.0:1789601730.400417:0:18578:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.400435:0:18578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18578:1876532918443776:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789601730.400534:0:18578:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4f73a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601730.400652:0:19127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+8:15657:x1876532898438016:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 14596us (14904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.400662:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1789601730.406312:0:18578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c7b34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18578:1876532918443776:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789601730.406358:0:18578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601730.406435:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2415:x1876532898438144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 6700us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601730.406447:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789601730.418977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.419222:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438272 00000100:00100000:0.0:1789601730.419236:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438272 00000100:00100000:0.0:1789601730.419307:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601730.419320:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2416:x1876532898438272:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789601730.419541:0:18554:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789601730.419545:0:18554:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789601729 00002000:00010000:0.0:1789601730.419550:0:18554:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789601728 00002000:00010000:0.0:1789601730.419552:0:18554:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789601730 -> 1789601729 00002000:00010000:0.0:1789601730.419554:0:18554:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789601730.420017:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+8:2416:x1876532898438272:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 698us (1052us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789601730.420388:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601730.428445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601730.429965:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438400 00000100:00100000:3.0:1789601730.429985:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438400 00000100:00100000:3.0:1789601730.430117:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789601730.430129:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c1946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+8:2415:x1876532898438400:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789601730.430191:0:18553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.430216:0:18553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.430226:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601730.430231:0:18553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601730.430237:0:18553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.430285:0:18553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.430303:0:18553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.430321:0:18553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18553:1876532918443904:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601730.430436:0:18553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4efc64300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601730.438859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.438965:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438528 00000100:00100000:2.0:1789601730.438978:0:17030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438528 00010000:00010000:2.0:1789601730.439031:0:17030:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 9 pid: 19127 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601730.439097:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789601730.439110:0:17030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+9:2415:x1876532898438528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601730.439129:0:17030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601730.439157:0:17030:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 9 pid: 19127 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.439173:0:17030:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 9 pid: 19127 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.439215:0:17030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601730.439221:0:17030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601730.439228:0:17030:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.439240:0:17030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.439265:0:17030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601730.439349:0:17030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+9:2415:x1876532898438528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 242us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.439357:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:0.0:1789601730.439670:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006579c5a3/0x74872e3eca9f2e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49037 expref: 8 pid: 19127 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.439705:0:18553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18553:1876532918443904:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789601730.439734:0:18553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439745:0:18553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439753:0:18553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439777:0:18553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439788:0:18553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439798:0:18553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439807:0:18553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382a00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:0.0:1789601730.439812:0:18553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439823:0:18553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439844:0:18553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.439852:0:18553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b756e490/0x74872e3eca9f2e46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601730.439936:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c1946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2415:x1876532898438400:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 9809us (11505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601730.439946:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789601730.443014:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.443130:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438784 00000100:00100000:2.0:1789601730.443149:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438784 00000100:00100000:2.0:1789601730.443246:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789601730.443259:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+16:15657:x1876532898438784:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.443374:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.443398:0:19998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 16 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.443410:0:19998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.443458:0:19998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 16 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.443475:0:19998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 16 pid: 17047 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601730.443493:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444032:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601730.443628:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601730.447488:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444032:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789601730.447532:0:19998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.452229:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.460543:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898438912 00000100:00100000:1.0:1789601730.460613:0:17031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898438912 00010000:00010000:1.0:1789601730.460685:0:17031:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 17 pid: 17047 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.460743:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789601730.460755:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+17:2416:x1876532898438912:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601730.460774:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601730.460783:0:17031:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 17 pid: 17047 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460837:0:17031:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 17 pid: 17047 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460867:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7383400/0x74872e3eca9f2d97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a48ff8 expref: 17 pid: 17047 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460891:0:17031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:1.0:1789601730.460898:0:17031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 16 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460909:0:17031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460917:0:17031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460925:0:17031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.460969:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601730.461044:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+16:2416:x1876532898438912:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 292us (8825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601730.461052:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00010000:00010000:2.0:1789601730.461918:0:19998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.461932:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.462468:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.462489:0:19998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 16 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.462499:0:19998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.462552:0:19998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 16 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.462667:0:19998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 16 pid: 19998 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601730.462686:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444160:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789601730.462783:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12de300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601730.471384:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789601730.471475:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439040 00000100:00100000:3.0:1789601730.471489:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439040 00010000:00010000:3.0:1789601730.471531:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 17 pid: 19998 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.471618:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789601730.471631:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+17:2415:x1876532898439040:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601730.471646:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601730.471655:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 17 pid: 19998 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.471669:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 17 pid: 19998 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.471693:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:3.0:1789601730.471699:0:17032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.471709:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.471716:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.471738:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601730.471750:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49022 expref: 17 pid: 19998 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601730.471776:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444160:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789601730.471798:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+16:2415:x1876532898439040:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601730.471807:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00010000:00010000:2.0:1789601730.471829:0:19998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.471859:0:19998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.471866:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601730.472009:0:19998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789601730.473043:0:19998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789601730.473111:0:19998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789601730.475395:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19998:1876532918444288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789601730.475515:0:19998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601730.475588:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601730.476506:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918444288 00000100:00100000:1.0:1789601730.476526:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918444288 00000100:00100000:1.0:1789601730.476633:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789601730.476644:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19998:x1876532918444288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789601730.476929:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19998:x1876532918444288:12345-0@lo:1000:mdt00_003.0 Request processed in 284us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601730.476938:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789601730.476983:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3436300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19998:1876532918444288:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789601730.477214:0:19998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789601730.477289:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19998:1876532918444416:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789601730.477354:0:19998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601730.477391:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4d12ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601730.477738:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918444416 00000100:00100000:1.0:1789601730.477747:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918444416 00000100:00100000:1.0:1789601730.477789:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601730.477808:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19998:x1876532918444416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789601730.477973:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19998:x1876532918444416:12345-0@lo:1000:mdt00_003.0 Request processed in 168us (619us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789601730.477980:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601730.478434:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4c12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19998:1876532918444416:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789601730.478486:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478497:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478505:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478511:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601730.478516:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478524:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478554:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:3.0:1789601730.478582:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601730.478589:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478596:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c400/0x74872e3eca9f2e54 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478629:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478648:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478655:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478661:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b7c00 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601730.478665:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478672:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478683:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601730.478686:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601730.478695:0:19998:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 19 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478706:0:19998:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 19 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478717:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 19 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.478795:0:19998:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737dc00/0x74872e3eca9f2db3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a49006 expref: 19 pid: 19998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.478809:0:19998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444544:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789601730.478895:0:19998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df4c11ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601730.483903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.483979:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439168 00000100:00100000:2.0:1789601730.483997:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439168 00000100:00100000:2.0:1789601730.484102:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789601730.484118:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f761ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15656:x1876532898439168:12345-192.168.203.48@tcp:49:dd.0 00000100:00100000:2.0:1789601730.484336:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f761ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15656:x1876532898439168:12345-192.168.203.48@tcp:49:dd.0 Request processed in 222us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.484345:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789601730.485112:0:19998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4f74c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19998:1876532918444544:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789601730.485147:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485160:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b7c00/0x74872e3eca9f2dac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485220:0:19998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485239:0:19998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485254:0:19998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485265:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485271:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485278:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485283:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f7382400 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601730.485287:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485295:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485333:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601730.485336:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601730.485340:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485347:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f7382400/0x74872e3eca9f2e5b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485358:0:19998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485364:0:19998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485370:0:19998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485375:0:19998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737c800 already unused, calling callback (ffffffffc1b3a4f0) 00010000:00010000:3.0:1789601730.485377:0:19998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485383:0:19998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485391:0:19998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:3.0:1789601730.485393:0:19998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601730.485397:0:19998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601730.485403:0:19998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737c800/0x74872e3eca9f2e4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601730.485644:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+19:15657:x1876532898438784:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 42386us (42638us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789601730.485654:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000020:00080000:3.0:1789601730.485661:0:19998:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789601730.486179:0:17081:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789601730.486253:0:17081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601730.486276:0:17081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789601730.486283:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789601730.492524:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601730.492649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.492687:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439296 00000100:00100000:2.0:1789601730.492701:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439296 00000100:00100000:0.0:1789601730.492727:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439552 00000100:00100000:0.0:1789601730.492744:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439552 00000100:00100000:2.0:1789601730.492786:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:2.0:1789601730.492808:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15656:x1876532898439296:12345-192.168.203.48@tcp:101:dd.0 00000100:00100000:0.0:1789601730.492825:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1789601730.492849:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+20:15657:x1876532898439552:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1789601730.492861:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601730.492895:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e62 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63fec2fe55a4903e expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.492941:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2e69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.492960:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2e69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.492974:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2e69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.493110:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737da00/0x74872e3eca9f2e62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4903e expref: 22 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.493137:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4f737de00/0x74872e3eca9f2e69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0x63fec2fe55a4903e expref: 22 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.493146:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df4f3972b00) 00010000:00010000:2.0:1789601730.493150:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789601730.493155:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df4f737de00, rc 0) 00000004:00080000:0.0:1789601730.493222:0:17049:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789601730.493256:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789601730.493292:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493309:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493320:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493329:0:17049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493352:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493359:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.493378:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789601730.493709:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+23:15656:x1876532898439296:12345-192.168.203.48@tcp:101:dd.0 Request processed in 668us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.493719:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:1.0:1789601730.493817:0:17033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601730.493827:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.493835:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6200 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601730.493840:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.493851:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.493864:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df4e1615400) 00010000:00010000:1.0:1789601730.493867:0:17033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601730.493872:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.493892:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df4fb6b6200/0x74872e3eca9f2e70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.493905:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601730.493907:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601730.493909:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601730.494987:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c7b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+22:15657:x1876532898439552:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 2130us (2324us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789601730.495002:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000020:00080000:0.0:1789601730.495010:0:17049:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789601730.576461:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601730.804701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789601730.804988:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439680 00000100:00100000:0.0:1789601730.805015:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439680 00000100:00100000:0.0:1789601730.805092:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789601730.805103:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2417:x1876532898439680:12345-192.168.203.48@tcp:4:dd.0 00002000:00010000:0.0:1789601730.805150:0:18557:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aab27c1, atime: 0x6aab27c0, ctime: 0x6aab27c1, blocks: 0x0 00010000:00010000:0.0:1789601730.805158:0:18557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.805174:0:18557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=598s v=(0 0) 00010000:00010000:0.0:1789601730.805178:0:18557:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601730.805184:0:18557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601730.805198:0:18557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.808350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789601730.808475:0:18559:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601730.808486:0:18559:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789601730.808979:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439808 00000100:00100000:1.0:1789601730.808988:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439808 00000100:00100000:2.0:1789601730.810141:0:20186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1789601730.810157:0:20186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+8:2418:x1876532898439808:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:2.0:1789601730.810202:0:20186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.810219:0:20186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601730.810224:0:20186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601730.810231:0:20186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601730.810246:0:20186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601730.890795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601730.890817:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918444672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601730.890882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601730.890937:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918444672 00000100:00100000:2.0:1789601730.890945:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918444672 00000100:00100000:2.0:1789601730.891001:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789601730.891011:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918444672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601730.891039:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789601730.891099:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876532918444672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601730.891106:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789601730.891129:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601730.891165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876532918444672:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789601730.920707:0:19366:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789601730.920725:0:19366:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1789601730.921631:0:18557:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789601730.921637:0:18557:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789601729 -> 1789601730 00002000:00010000:1.0:1789601730.921640:0:18557:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789601729 -> 1789601730 00002000:00010000:1.0:1789601730.921642:0:18557:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1789601730.921660:0:18557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921673:0:18557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921682:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921688:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4fb6b6e00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601730.921693:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921701:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921736:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.921743:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f257ec3/0x74872e3eca9f2e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.921828:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+7:2417:x1876532898439680:12345-192.168.203.48@tcp:4:dd.0 Request processed in 116722us (117132us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789601730.921843:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000001:00080000:2.0:1789601730.981814:0:19366:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789601730.982207:0:20186:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1789601730.982212:0:20186:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1789601730.982229:0:20186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982241:0:20186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982251:0:20186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982259:0:20186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df4f737da00 already unused, calling callback (ffffffffc0ef38b0) 00010000:00010000:1.0:1789601730.982263:0:20186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982272:0:20186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982311:0:20186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601730.982319:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000740ed347/0x74872e3eca9f2e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601730.982441:0:20186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2418:x1876532898439808:12345-192.168.203.48@tcp:4:dd.0 Request processed in 172285us (174096us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789601730.982452:0:20186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1789601731.398714:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601731.398739:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918444800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601731.398807:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601731.398858:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918444800 00000100:00100000:1.0:1789601731.398865:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918444800 00000100:00100000:1.0:1789601731.398923:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789601731.398931:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918444800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789601731.398963:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789601731.399014:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918444800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601731.399021:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789601731.399102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918444800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789601731.399911:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789601731.399946:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601731.400249:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918444928 00000100:00100000:2.0:1789601731.400268:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918444928 00000100:00100000:2.0:1789601731.400309:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601731.400317:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918444928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789601731.400340:0:17050:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789601731.400392:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918444928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601731.400398:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601731.400602:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c3435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918444928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789601731.589753:0:17800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601731.910155:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918445440:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910232:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910266:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918445952:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910311:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918446464:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910335:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910360:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789601731.910365:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910425:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910439:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918446336:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.910458:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.910487:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445440 00000100:00100000:0.0:1789601731.910494:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445440 00000100:00100000:0.0:1789601731.910532:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445952 00000100:00100000:0.0:1789601731.910535:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445952 00000100:00100000:3.0:1789601731.910740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918445184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910770:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918445696:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910807:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918446208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910839:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910856:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789601731.910862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918445056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910914:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c1945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918445568:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910934:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910948:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918446080:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.910977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918446592:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.910999:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.911035:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446464 00000100:00100000:3.0:1789601731.911040:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446464 00000100:00100000:3.0:1789601731.911084:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446336 00000100:00100000:3.0:1789601731.911088:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446336 00000100:00100000:3.0:1789601731.911101:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446208 00000100:00100000:3.0:1789601731.911103:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446208 00000100:00100000:3.0:1789601731.911114:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445568 00000100:00100000:3.0:1789601731.911116:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445568 00000100:00100000:3.0:1789601731.911126:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446080 00000100:00100000:3.0:1789601731.911128:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446080 00000100:00100000:3.0:1789601731.911138:0:19998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446592 00000100:00100000:3.0:1789601731.911140:0:19998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446592 00000100:00100000:3.0:1789601731.911154:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601731.911162:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918446464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911217:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876532918446464:12345-0@lo:400:kworker.0 Request processed in 55us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601731.911223:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789601731.911266:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876532918446464:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911293:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601731.911300:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918446336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911337:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876532918446336:12345-0@lo:400:kworker.0 Request processed in 37us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601731.911342:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789601731.911368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4eff44380 x1876532918446336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601731.911380:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876532918446336:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911397:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789601731.911404:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911436:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876532918446208:12345-0@lo:400:kworker.0 Request processed in 33us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601731.911450:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789601731.911477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876532918446208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911496:0:19998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789601731.911502:0:19998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918445568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.911535:0:19998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876532918445568:12345-0@lo:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601731.911541:0:19998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601731.911733:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445312 00000100:00100000:0.0:1789601731.911738:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445312 00000100:00100000:0.0:1789601731.911755:0:18552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445824 00000100:00100000:0.0:1789601731.911758:0:18552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445824 00000100:00100000:0.0:1789601731.911772:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601731.911779:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918445440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601731.911932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918446848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601731.912062:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789601731.912072:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918446080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.912138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876532918445568:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.912154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918446720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789601731.916227:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918445440:12345-0@lo:400:kworker.0 Request processed in 4439us (5986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.916242:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601731.916277:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601731.916289:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918445952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.916700:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918445952:12345-0@lo:400:kworker.0 Request processed in 414us (6406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.916707:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601731.916722:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601731.916730:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918445312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.916763:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876532918445312:12345-0@lo:400:kworker.0 Request processed in 35us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.916769:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601731.916780:0:18552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601731.916786:0:18552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.916818:0:18552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918445824:12345-0@lo:400:kworker.0 Request processed in 32us (6392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.916823:0:18552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789601731.916851:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445056 00000100:00100000:0.0:1789601731.916858:0:17037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445056 00000100:00100000:0.0:1789601731.916897:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789601731.916903:0:17037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918445056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.916933:0:17037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0068b5de-bd03-471c-817a-758c66ef4c46+24:3648:x1876532918445056:12345-0@lo:400:kworker.0 Request processed in 31us (6044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.916940:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1789601731.916984:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601731.916990:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601731.916992:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601731.916995:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601731.918132:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789601731.918147:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918446592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.918206:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876532918446592:12345-0@lo:400:kworker.0 Request processed in 65us (7205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.918212:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789601731.918268:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445184 00000100:00100000:0.0:1789601731.918274:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445184 00000100:00100000:0.0:1789601731.918297:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918445696 00000100:00100000:0.0:1789601731.918299:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918445696 00000100:00100000:0.0:1789601731.918310:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601731.918316:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.918351:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876532918445184:12345-0@lo:400:kworker.0 Request processed in 34us (7579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.918356:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601731.918368:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601731.918374:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918445696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.918403:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918445696:12345-0@lo:400:kworker.0 Request processed in 29us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.918409:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601731.918867:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df4eff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918446976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789601731.918907:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.918955:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.918964:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.918986:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1789601731.918990:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df4cd0b9c00, transno 8589934596 00000004:00080000:0.0:1789601731.919000:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1789601731.919103:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876532918445440:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.919119:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918445952:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.919173:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446976 00000100:00100000:0.0:1789601731.919177:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446976 00000100:00100000:0.0:1789601731.919206:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601731.919213:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4eff45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918446976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789601731.919229:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789601731.919267:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4eff45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876532918446976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.919273:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601731.919297:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876532918446976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789601731.919716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601731.919786:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446848 00000100:00100000:0.0:1789601731.919790:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446848 00000100:00100000:0.0:1789601731.919818:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601731.919824:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918446848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601731.919840:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789601731.919872:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876532918446848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.919878:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601731.919960:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876532918446080:12345-0@lo:400:kworker.0 Request processed in 7889us (8990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601731.919968:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601731.920081:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876532918446848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601731.920661:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601731.920697:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0068b5de-bd03-471c-817a-758c66ef4c46:3648:1876532918445056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.920708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876532918446080:0@lo:400:kworker.0 00010000:00080000:3.0:1789601731.920720:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df4eff45500 x1876532918446592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601731.920730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876532918446592:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.920740:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c1946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876532918445184:0@lo:400:kworker.0 00000100:00100000:3.0:1789601731.920749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df4eff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918445696:0@lo:400:kworker.0 00000100:00100000:0.0:1789601731.920835:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532918446720 00000100:00100000:0.0:1789601731.920840:0:18555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532918446720 00000100:00100000:0.0:1789601731.920880:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789601731.920888:0:18555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918446720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789601731.920915:0:18555:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789601731.920960:0:18555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4f74c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876532918446720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601731.920966:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601731.923768:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df3c433e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876532918446720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789601732.614779:0:17033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601732.615397:0:20223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789601732.897887:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.897926:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.897967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.897997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898083:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898126:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789601732.898163:0:18553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440320 00000100:00100000:0.0:1789601732.898275:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440064 00000100:00100000:0.0:1789601732.898283:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440064 00000100:00100000:0.0:1789601732.898364:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440576 00000100:00100000:0.0:1789601732.898368:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440576 00000100:00100000:0.0:1789601732.898382:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440192 00000100:00100000:0.0:1789601732.898384:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440192 00000100:00100000:0.0:1789601732.898396:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440704 00000100:00100000:0.0:1789601732.898399:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440704 00000100:00100000:0.0:1789601732.898417:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:0.0:1789601732.898443:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+22:2416:x1876532898440064:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.898543:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+22:2416:x1876532898440064:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 117us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.898551:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:0.0:1789601732.898594:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:0.0:1789601732.898602:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2416:x1876532898440576:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.898631:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+6:2416:x1876532898440576:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.898638:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:0.0:1789601732.898650:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789601732.898656:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440192:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.898676:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440192:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 21us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.898704:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789601732.898717:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789601732.898937:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440704:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.898984:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440704:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 260us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.898991:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789601732.899018:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440832 00000100:00100000:0.0:1789601732.899023:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440832 00000100:00100000:0.0:1789601732.899054:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440448 00000100:00100000:0.0:1789601732.899058:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440448 00000100:00100000:0.0:1789601732.899072:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898440960 00000100:00100000:0.0:1789601732.899075:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440960 00000100:00100000:0.0:1789601732.899089:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601732.899095:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440832:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.899121:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440832:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.899127:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789601732.899138:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601732.899144:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440448:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.899169:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440448:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.899188:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789601732.899198:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789601732.899205:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440960:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789601732.899238:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e405907e-9072-4b15-9fd7-2bb5f7d7c0b7+5:2416:x1876532898440960:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 34us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601732.899244:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00080000:0.0:1789601732.899262:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601732.899266:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601732.899269:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789601732.899271:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601732.900227:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532898439936 00000100:00100000:2.0:1789601732.900238:0:17038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898439936 00000100:00100000:2.0:1789601732.900296:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:2.0:1789601732.900306:0:17038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+13:2416:x1876532898439936:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789601732.900364:0:17038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df4c433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:436a5db0-0172-499e-8bf1-5cb020bea989+13:2416:x1876532898439936:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 60us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601732.900370:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:1.0:1789601732.900837:0:18553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532898440320 00000100:00100000:1.0:1789601732.900893:0:18553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789601732.900902:0:18553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8df3c433d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440320:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789601732.900941:0:18553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8df3c433d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd6d66ee-38de-4023-8d86-925c5cce8186+5:2416:x1876532898440320:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 41us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601732.900947:0:18553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00080000:2.0:1789601732.903126:0:17041:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789601733.573847:0:17081:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789601733.573859:0:17081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601733.573884:0:17081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789601733.573911:0:17081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789601733.639879:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43194 lines, 43194 kept, 0 dropped, 0 bad.